Do you say in agreement with or of?

The correct phrase is "in agreement with." This expression is used to indicate that someone shares the same opinion or viewpoint as another person or group. For example, you would say, "I am in agreement with your proposal."