Does gas mileage really get better on a new car the longer you drive it?

Probably not. It might get a tiny bit better in the first few miles (probably under the first 100 miles) as the engine and gearing first wears in. But with today's cars I doubt it is noticeable.

There definitely isn't going to be an improvement after the first oil change.