Is a size 34-36 inch waist too big?

no. probally small or medium pending on your height. it could also depend on your country. im 6'4'' 240lbs and im canadian. here im an XL, in USA im L. in Europe im 2XL, and in Hong Kong im 4XL.