Do you have to worry about the graft when planting a rose bush?

Yes, if you damage or break the graft the scion (or part above the graft) can die, this would mean that the plant you had purchased for a specific flower or fruit characteristic would be lost - in most cases the root stock would then grow out, which has different characteristics to the scion