Do you have to respond to the other party's adjuster or you only need to talk to your own insurance adjuster?

I would only give the statement of facts of loss and then tell the other adjuster to refer any other questions to your adjuster.