Why should you use semi gloss on interior trim?

Because it's only intended for trim, doors, and Windows, if it's used on all the wall, it will make that wall look cheap. A better choice for a wall is a washable, matte paint that will not show off every imperfection the way a semi-gloss will.