Will water instead of milk in banana muffins make a big difference?

yes you can. They will turn out just fine. you can even add some cinnomon on them half baked to make them taste even better