Are the rows and columns in Excel infinite?

No. In versions up to Excel 2003 there are 256 columns and 65,536 rows. From 2007 on, there are 16,384 columns and 1,048,576 rows.