In a chemical reaction are the atoms and molecules that combine with each other to make new molecules called reactants?

Yes, a reactant is a substance that takes part in and undergoes change during a reaction.

Products are those substances produced as a result of a reaction.

Catalysts are substances that take part in a reaction but are left unchanged by the reaction (they speed up the reaction rate).