Why does order of integers matter when subtracting?

Imagine you are subtracting in real life. If you have eight Apples, but then you eat three of them, you only have five left. Therefore, 8 - 3 = 5.

However, if you have three Apples, and take away eight, you have -5 Apples. Which is impossible.