Are all polymers made of chains smaller molecules?

Yes. That is why they are called polymers. The prefix "poly-" means many. A polymer is made from many monomers.