It's okay for pus to come out when you have your tongue pierces?

No. Its normal to have a whitish/yellow fluid that may cause crust to form but not pus.