What is the person going against you in a debate named?

The person going against you in a debate is called the "opponent" or "debate opponent." In formal debate settings, they may also be referred to as the "negative" if they are arguing against the resolution or proposition you are supporting. In some contexts, they might simply be known as the "adversary."