Do you capitalize the word rabbi?

Not if used in general, as in "I spoke with the rabbi." But it is capitalized when used with a proper name, as in "Rabbi Elias was in attendance."

When referring to a rabbi in writing, on first reference, capitalize before a name. On second reference use only the last name.