Can any house be a manor?

The manor house was the home of the lord of the manor. In theory, he could choose any house he wanted to be his manor, but in practice, he always had the largest and most comfortable.

There is a link to a related question below, and there are other links from it.