Can you paint wood furniture with a latex semigloss paint?

I have tried it in the past.

It looked good at first, then after it dried.

The latex peeled right off.

Then I really sanded it down & tried again.

seemed like the oil base sinks into the wood & the latex peeled again.

Sorry but that was my disaster.