Is this how to spell by-the-way?

No. The phrase is spelled "by the way" (an aside). You would only use the hyphens if the phrase "by the way" was being used as an adjective, as is seen in the term "out-of-the-way location."