What is the point called at the beginning of a ray?

The point at the beginning of a ray is called the "endpoint." A ray starts at this endpoint and extends infinitely in one direction. In geometric notation, it is usually represented as a point with an arrow indicating its direction.