Does Japanese writing go across or down?

It goes both ways actually, and there are names for both. 横書き (yokogaki), is the term for horizontal writing (written left to right, top to bottom) and 縦書き (tategaki) is the term for vertical writing (written top to bottom, right to left).