what's the point of FP if processors are still Von Neumann?

You are shooting yourself in the foot by thinking in a manner inconsistent with the computer.

FP is useful if you want to do calculations with a range much bigger than the precision. It's not "inconsistent", it's just as exact as integer maths but has different rules.