Should officer be capitalized when saying Officer Smith?

Yes. In this context, he is being referred to by name, and the Word 'Officer' is part of his official title. If, however, you were saying that "John Smith is an officer", no capital would be required.