Can you put primer on scuffed base coat or scuffed clear coat?

you can put primer on scuffed surfaces. but really its a waste. if you scuff the paint with 320 grit sandpaper thats all you should need . unless you sand down to bare metal then you can hit it with primer