When did the US penal system begin?

From what I can find, the first modern prison in the US, what could be called a prison or penetentiary was the Walnut Street Jail, built in 1773 in Philladelphia, PA. More accurately, the US was built on the idea of the penal system, insofar as there were several penal colonies chartered in America by European nations; think Georgia.