Car starts really rough and then it starts to run smoothly the gauge shows that it is overheating?

If it starts very rough but then clears out expect either fouling of spark plugs or a mixture problem that clears up when O2 feedback becomes available.

As far as the gage showing overheating... does it show this immediately after a cold start? Have you considered actually taking its temperature with a suitable tool?