What kind of charge would the hydrogen atoms have compared to the oxygen?

I'm assuming you mean when they're bonded to each other - oxygen is more electronegative, so it will have a partial negative charge, and hydrogen will have a partial positive charge.