How soon can you paint after caulking?

Most primers can be re-coated in an hour or two, It always says in the instructions on the can.