Do we need calories to grow?

It depends on what you mean. Calories give you energy and energy helps you move, talk, and do other things so in a way, yes you do need calories to grow.