What is the proof that the Bayes classifier is the optimal classifier in terms of minimizing the classification error?

The Bayes classifier is considered optimal because it minimizes the classification error by making decisions based on the probability of each class given the input data. This is supported by mathematical proofs and theory in the field of statistics and machine learning.