Are prime numbers rectangular in shape?

No, they are the only numbers that are NOT rectangular in shape. (I think you knew this and screwed up your question.) That is, all non-primes can be arranged into the form of a rectangle - e.g. 21 can be organized as a rectangle with dimensions of 3 x 7. But prime numbers cannot be organized as rectangles.