When please already used in the sentence is it not allowed to use kindly?

That's not a rule in the English language. It might seem redundant to some, but it would still be correct to say "Please, would you kindlly allow me to escort you to the ball."