Are there pennies from the 1800s?

There would be no Australian and New Zealand pennies prior to the 20th Century. The British have been producing Pennies for over a thousand years. The US have a 1 cent coin which they refer to as a Penny.