What is a best-fit line as a math definition?

Best-fit line is used in a graph with a whole bunch of dots. If the dots are grouped up and that they are all going in a direction if there is one then there should be a best-fit line which is only a line going down there path to point that it's not changing.