Does convalescent leave start the day you are discharged from the hospital?

Yes, it defeats the purpose if you go back to work drugged and unable to perform your duties as an active military member. You would need your command's permission to go on convalescent leave, but it would be nice to remind them beforehand the starting date, which is on your papers, and the date before you return to work.