Would you go to jail if you accidentally took a cup for a restaurant?

Not likely, a business owner would need to file theft charges and even at that its petty larceny which would only have jail time if it were a repeat offense.

Normally they would be happy just getting their cup back.