Is it okay for my boyfriend to check out other girls?

Not sure it's OK exactly, but it is almost universal male behavior. I hope it's done discreetly, so as not to be a nuisance for you.