Is grabbing someone's side sexual harassment?

No, grabbing someone's side does not usually fall under sexual harassment. But this depends on context, if you were asking someone to perform a sexual act on them and grabbed them as they walked away this could be included.