Does a wheel size matter on a fixie?

Kinda-sorta.

The wheel size has to match the frame/fork size, and the frame size should match the body size and riding type of the rider.

Overall smaller wheels will be stronger and easier to bring up to speed than bigger wheels. But bigger wheels roll smoother and offer a higher available gearing - which rarely is important outside a race setting.