Why cant you travel south from the South Pole?

Once you've reached the south pole, you can only move away from the pole. And since you are moving away from the south pole you can't be traveling south.