Is it against the law to remove an item from a gravesite that was left there by someone else?

It depends upon the rules and regulations of the graveyard in question. In most cemeteries, nothing can be left at the grave. Flowers and wreaths remain only until the next mowing session. Items left at a grave are normally considered abandoned.