Can i replace 300mAh 2.4 volt battery with a 400mAh 2.4 volt battery?

Yes, that should cause no problem because the voltage is the same (a small discrepancy should usually be tolerable). The larger "mAh" rating simply tells you that the battery will last longer, for any given load.