Will an illegal immigrant trying to leave US be arrested?

No, a person who has entered the US illegally is free to leave, and will not be arrested, unless, of course, there are other crimes in addition to illegal entry to the country for which this person is sought by the police. For example, a person who enters illegally and commits murder while in the country is no longer free to leave at will.