Is tar paper waterproof without shingles?

No.Tar paper is resistant but not fully so until it is shingled. When combined with a shingle system it will help shed water and keep humidity from rotting the plywood.