How do the sun and moon float?

They do not actually float. The moon is constantly pulled toward Earth by gravity, but it is moving "sideways" rather quickly relative to Earth so it has quite a bit of momentum. By the time it would have fallen to Earth it has missed. This is how an orbit works. Similarly Earth orbits the sun and the sun orbits the center of the galaxy.