Does humor have a long vowel sound?

Yes. Humor has the long U (yoo) sound in humid and human. The Words rumor and tumor have the long OO instead (as in boomer), so they are not perfect rhymes.