If you want to paint do you have to start out on canvas?

Yes, however, in many cases the graphite can and will either show through or lift to the surface, so be certain to use a very hard pencil, and the minimum amount of lines you need as reference.