Will bee go away if they can not get at the nest?

No. It's the only home they have, so they'll keep trying to get in until they drop dead.