What is the response to parlez vous francais?

For you, "Non".

The question asks "Do you speak French?"

So, yes is "oui" and no is "non".