Do Republicans make up a majority of the membership of all House Committees?

No. Since the Democrats control the House, they get to appoint a majority of the committee members.