Do all birds have beaks or bills instead of teeth?

Yes. The only tooth that a modern bird could have that I am aware of is an egg tooth that some chicks possess when they are trying to hatch from the egg but the egg tooth falls off soon after hatching.