Should you put a comma before too?

Not necessarily. Commas are a feature of sentence structure. There is no Word or phrase that requires one. For example: I like it too much; I like it, too.