How do you know what the word that refers to when someone says That is why?

The pronoun 'that' in the sentence, "That is why." refers to the sentence(s) or explanation preceding it, which would be a response to a question starting with 'why'.