Do you have to be called Mrs if you keep your ex-husband's name?

Your choices are limited. While you are no longer Mrs Whatever - meaning Mr Whatever's wife, you are surely not going to adopt the title 'Miss' again, which would make you appear to be Mr Whatever's daughter or sister.

I would suggest you adopt the neutral female title 'Ms', pronounced Mizz. It is neither Mrs or Miss and is widely accepted these days.