Do Muslims worship in a synagogue?

No; Jews pray to God, creator of the universe. Muhammad is associated with Islam, not with Judaism. Judaism has no connection to Muhammad and does not have an official religious position on him other than him not being a prophet.

Note that Muslims also do not pray to Muhammad. Muslims pray to Allah (using the Qur'an which they say that Muhammad revealed).