Can you go to the courthouse and turn yourself in?

Yes.

Added: If you are wanted for a criminal offense, it would probably be simpler and quicker to just surrender at the local law enforcement agency. If you turn yourself in at the courthouse, they are only going to have to call the police to come and get you anyway.