Does USCIS know when I leave the country?

Yes, USCIS may know when you leave the country if you are on a visa or have a pending Immigration application with them. They may track your departures and arrivals through various systems and databases.