Is a square always a rectangle and rhombus?

Yes, a square is a specific type of rectangle or rhombus. The only qualifications for a rectangle are that the corners have the make 90 degree angles and the sides have to be parallel, any square meets those qualifications.