Can only regular polygons with an odd number of sides can make a regular tessellation?

No. Squares and regular hexagons, both with an even number of sides, can make regular tessellations.