Is texture the actual visual brightness of a surface?

No. The actual visual brightness of a surface is Chroma or Intensity. Texture is the way the surface feels to the mind (cause you can't actually touch it), whether it's smooth, or choppy, or looks bumpy..