Do you feed a baby bird water?

You don't, if you give them water they can get a serious condition where water gets inside their lungs. If their food is slightly moist, they should get enough water from that.