Do we just need calories for energy?

Yes, but not just for energy for your body to move. Your heart and lungs need energy to function, as does your brain and all of your organs.