Do you have to use baking soda for a sponge cake?

No, if you put soda in a cake it would probably taste horrible and it would be all mushy and squishy and damp. What you do have to put in, however, is baking soda which looks like white flour.