Is baking powder is safe to drink?

Yes. Baking powder is a food item and perfectly safe to ingest. Baking powder is a mixture of either Alum and baking soda, or tartaric acid (cream of tartar) and baking soda.