How high is up?

Up is are far as you can go before leaving one gravity field and entering another. Once you enter a new gravitational field, you are no longer going up.