Can you finger your butt without being gay?

Yes, all kinds of people enjoy anal stimulation, gay and straight. Some people never do it, of course. But it doesn't mean you are gay. You are gay if you are sexually and romantically attracted to the same sex.

Men probably enjoy anal stimulation more because they have a prostate in there, which enjoys being stimulated.