What do mammals possess that set them apart from other vertebrates?

Mammals are characterized by being an amniote, and has mammary glands that produce milk (there are some exceptions. These exceptions includes monotremes that lay eggs and has no nipples, but still produce milk. Others, such as marsupials, completes developments in mother's pouch, and not in a uterus.)