Why are penguins considered as birds?

The characteristics of a bird is that is has feathers as its outer covering ,beak ,wings.The ability to fly is actually an exception. Most birds can fly while some bird's can't. Penguin is one of those exceptions which can't fly. Other examples will be ostrich and emu.