How do you detach gun turrets in wolfenstein the new order?

Approach a mounted turret and hold the 'E' key rather than a single press. A single press will make you use the mounted turret, while holding E will make you detach it.