Can you leave the country after you apply for the citizenship?

Well, there is no law prohibiting to go on a vacation while waiting for your naturalization certificate. However, they can deny you re-entry to the US if they find you are inadmissible; but this unlikely if you are a permanent resident and have not been convicted of a crime while residing in the US. If you have, then you should consult an attorney.