Can you eat the inside of a tea bag?

I don't think so. No where on the package (at least on my tea) does it say 'Do not injest contents' like it does on those little bags of moisture absorber that you find in various products.

I've read elsewhere on other forums that some people are doing this to extract the maximum nutrition from the tea. I would contact your tea manufacturer for sure, though to make sure (I'm about to contact mine, after coming across this question).