Why does the check engine light go on and off on a 2003 Harley?

Because there's an intermittent issue which needs to be addressed. You need to have the DTCs (fault codes) read to find out which codes you have, what your active codes are, what your inactive codes are, and how many counts of each fault you have.