Is a couple of books under the bed a clause?

No, "a couple of books under the bed" is not a clause; it is a phrase. A clause must contain both a subject and a verb, whereas this phrase only includes a noun phrase without a verb. It describes a situation but does not express a complete thought.