Is it bad to exercise when you are underweight?

Depends on HOW you exercise.

Many, if not all endurance athletes are technically underweight, so it's not like it's gonna kill you instantly.

And exercise can help to put some healthy weight on.

But you'd want to watch your duration, don't go more than maybe 30-45 minutes, and to make sure you're eating properly before and after exercise.