Is each and every correct English?

yes1

Not incorrect so much as very informal, and not suitable for writing. Like "one and only" it seems to say more than it does.