Do all religions believe in a supreme being?

Not all of them do, but the main, monotheistic, religions do. (Christianity, Islam, Judaism). In fact, these three religions all believe in the very same God; their views really only differ when dealing with how to worship Him.