Is your ear meant to go white and 'wrinkly' when stretching?

No that means you are trying to stretch too fast, faster than the tissue has time to expand and develop to accept the stretch. Slow it down.