Is it grammatically correct to say with which?

Yes, it is grammatically correct to say "with which." This phrase is often used in formal writing when referring to something that is accompanied by or associated with another item or idea. For example, one might say, "The tool with which I completed the project was essential." However, in more casual contexts, simpler constructions like "that I used" might be preferred for clarity.