Can you just walk into a hotel without a reservation?

No, you typically need a reservation to stay at a hotel. Some hotels may have availability for walk-in guests, but it is not guaranteed. It is recommended to make a reservation in advance to ensure a room is available.