What is the true meaning of the idiom 'it's Greek to me'?

It just means you don't understand something.

The image is of the other person speaking a foreign language, such as Greek, that you don't understand.