What is the origin of wit's end?

"To wit is now just a fixed expression. It's a shortened form of that is to wit meaning "that is to know; that is to say; namely", from the English verb wit "to know"."

That would suggest (and this is just my guess) that to be "at your wit's end" is to be "at the end of your knowledge", or "to have exhausted all your known options".