You hit the starter on your jeep with a hammer and it works is this a early sign of bad starter?

Yes, sounds like a loose connection internaly or the Brushes are on there last legs, have it repaired or replaced before it costs you a tow job. Bad brushes will pitt the armature if you plan to have it repaired do it now and hopfully it won't cost you an armature.