When did prince Andrew get passed over by Charles as heir to the throne?

Assuming you are referring to the United Kingdom, Prince Andrew has never been the heir to the throne. Prince Charles is the oldest son of Queen Elizabeth and has, therefore, been the next in line since his mother became queen when he was four. Prince Andrew is 12 years younger than his brother.