What does going batty mean?

It means going crazy. See the related question for a definition of the full expression, which is "bats in your belfrey."