What is the meaning of 'up in a tree' in idiomatic expression?

I think you mean UP A TREE (not in one), which means you're stuck in a situation that you can't get out of easily - you've figuratively climbed up there, and now you're surrounded by figurative enemies and can't climb back down again.