Can you freeze a walleye you caught ungutted?

Yes, you can freeze a walleye (or any other fish) ungutted, but it is not a good idea.

To ensure the clean taste of fish, it is best to gut them, leave whole or cut into fillets before freezing.