Can what you wear be restricted at a shopping mall?

Yes indeed they can restrict what you wear.

Why? Because it's privately owned land. If, for example, a store says that you're not allowed to wear a shirt showing too much cleavage, or a bandanna that has gang affiliations, they have the right to remove you from their property.