When is it safe to remove a hornets nest?

if u kill them first by spraying them with the anti-bee smoke. then its safe. or if u are wearing a protective anti-bee suit.