Is challenging someone a threat

Could be. Maybe it's just a debate, or a game of skill, but is someone says to you in a menacing manner, like " Are you CHALLENGING me. ? " and you're not up to a fight, just say "Excuse me, I think we're having some kind of misunderstanding."