Why the tag is also stored in the cache?

The short answer is for speed. There is no point in storing data in a cache if there is no way to index the data to make it usable. Nor would there be any advantage if this data were stored in conventional DRAM.