What sets vertebrates apart from other animals?

The most obvious way in which mammals differ from the other four classes of vertebrates is that mammals nurture their young on mothers' milk.