You got punched in the temple and you are getting headaches is this dangerous?

Can be. The temple isn't well-protected, so trauma can extend inwards (this is why people hit you there). I'd do better answering this if you mention how long ago the incident occured, whether you were unconscious at any point, how often the headaches occur and for how long. and a number of other pertinent facts. Workling with what I have, I'd say call your doc and see if he can make this call.