If an American an Italian dual citizenship couple have a baby in Italy is baby a dual citizen?

Yes, the child can hold Dual Citizenship. You just need to contact the US embassy or consulate general and get a registration of birth abroad.