Can water based paint be stored in a furnace room?

Yes. Store any paints in a cool dry place that is not subject to high heat or freezing. It's better to store it in a temperature controlled utility room and avoid the garage.