Why do hockey teams take the goalie out during crucial moments of a game?

Hockey teams take out the goalie during crucial moments of a game to have an extra skater on the ice, increasing their chances of scoring a goal and potentially tying or winning the game.