Are tiny brown worms in the house a sign of a larger pest infestation that needs to be addressed?

Yes, tiny brown worms in the house can indicate a larger pest infestation that should be addressed promptly.