What is the difference between a label and a caption?

The difference is that a label is a name for something. A caption is a more specific description of the object, picture, etc.