Should restaurant names be underlined when writing a paragraph?

No you only underline the names of books. Just make sure you capiatalize it correctly and it is spelled the way that they spell it.