Is the kuiper belt part of the solar system?

Yes, it is the region beyond Neptune that extends to the edge of the solar system. Like the asteroid belt, this area contains left over parts that did not make it when the solar system was created. Pluto, comets, and other small and tiny items are scattered out here.