Is a cube a polyhedron

Yes. It is one of the five regular polyhedra known from ancient Greek times or earlier.

See http://www.math.rutgers.edu/~erowland/polyhedra.html .