Can you hook up 4 ohms stereo to 8 ohms speaker?

There is no real "4 ohms stereo". The output impedance is always less than 0.5 ohms. We use impedance bridging and not impedance matching. Scroll down to related links and look at "Impedance bridging - Wikipedia".