Should afternoon tea be capitalised

No, because it is not a proper noun. In the same way, you would not capitalise the first letter of breakfast, lunch, or dinner. However, if the Word "afternoon tea" was the name of a specific title for an event, eg Mad Hatter's Afternoon Tea, you may capitalise the first letters of each Word.