Wow, someone remembered something I said! ;D
It wasn't so much the floating point numbers that caused trouble in my platform game engine, but the conversion between floating points and integers. This was an optimisation bottleneck, because such conversions can be slow and in a grid-based game...