Are they any live wasps or queen in the nest in the winter?

Yes, the queen will over-winter in the nest with her workers. It is the males (drones) that may be kicked out to preserve food supplies over winter.