Does the buoyant force act in all directions?

Yes, but any bit of force in any horizontal direction is always exactly cancelled by

an equal-size bit of force in the opposite horizontal direction, so there's never a

NET horizontal buoyant force. It's only apparent in the upward vertical direction.