What was the connection between the Apostle Peter and the papacy?

According to historical reference, St. Apostle Peter was the first leader or pope of the early church. As the pope of the church, he was the one regarded as its first office-holder up to the recent times.