Can you check if ac relay is bad?

Yes, see link, but note: I would just by a multimeter instead of a test light (you can get a multimeter for as little as $3 from harbor freight)