Should heat be coming out of your oven when it is on?

yes, but not burning heat more like a warm heat.

The top and front might get a little warm, but, if you feel heat waves coming out and the door is closed, you may have a bad door fit.