Do all credit cards start with the number 4?

No, not all credit cards start with the number 4. Different credit card companies have different numbering patterns for their cards.