Can you take a Zyrtec while taking penicillin?

Yes, that's OK. Hydroxyzine is an antihistamine. It's fine to take antibiotics and antihistamines together. Remember to take all of the penicillin even after you start feeling better. You want to kill all the bacteria and not leave any hiding in your body!