What is John J Rambo's rank when he was in the military?

At least Sergeant.

That's the minimal rank soldiers have in the special forces.

According to John Rambo's Dossier in the Ultimate Edition of the Rambo Movies it states that he was promoted in the field to a Sergeant during the Vietnam War