Is it normal for a young puppy to walk sideways?

Yes! This is just caused because they are still a little off balanced, soon they will gain more balance and walk straight.