Why doesn' the sponge need symmetry?

No one organism really needs symmetry. When you think of symmetry though, you usually think of bilateral symmetry. This is when two sides of an organism are almost identical. The sponge just grows whichever way it pleases.