Do all hymentoptera insects have queens?

No. You only find queens who do all the egg-laying in colonies of social insects, such as ants, termites, honey bees and the like.

In solitary insects any female will lay eggs.