Can you short out a battery by replacing a starter?

yes if you dont remove the positive terminal off the battery before unistalling the starter or installing it the lead going to the starter will be hot.