Is latex paint harmful for skin?

That observation seems to speak for itself. If you are allergic to latex the use of latex pain would be especially risky as unset paints tend to emit all kinds of fumes until they are set. Personally I would advise against it.