Does it matter when you put put out the Elf on the Shelf?

If you take out the elf from a shelf, then you would only have a sh

So apparently it matters immediately after you remove the elf.