Why do people say excuse my french after swearing?

"Pardon my French" or "Excuse my French" is a common English language phrase ostensibly disguising profanity as French. The phrase is uttered in an attempt to excuse the user of profanity or curses in the presence of those offended by it under the pretense of the Words being part of a foreign language.