Is using a tea bag an example of filtration?

Yes it is, as it filters the solid from getting into the tea, but allows it's flavour to exit with the liquid (water and milk).