Is a column up or side to side?

A column is typically vertical, running up and down. In contrast, rows run side to side, horizontal across a page or table. Thus, if you're referring to a column, it refers to a vertical arrangement.