Can you use a mortise drill bit in a drill press?

Yes, you can. I have done so many times. Just be sure to reduce your drilling speed.