Does a 401k loan count as debt?

Yes, a 401k loan does count as debt because it is money borrowed from your retirement savings that needs to be repaid with interest.