Why is density needed to know whether a substance will float or sink in water?

It's actually pretty easy. If the density of the substance is higher than the density of water, the object will sink. If the density of the substance is lower than the density of water, the object will float.

Be aware though that various substances may have dissolved into the water, thus changing its density. For example, seawater has a different density than fresh water.