Why was the attack against Vicksburg by river just not possible for Union forces?

Because the town was built above sheer cliffs that were heavily defended by artillery.