Do you capitalize a street address?

No ... but the appropriate first letters of any names should be capitalized.

Eg: 25 Bath Street

Gelong, Victoria, Australia

...but you do not need to capitalize every letter

[Note: The address given is entirely 'ficticious'!]