Do aftermarket car warranties usually cover transmission problems?

They will usually cover transmissions if you choose a plan that covers the drive train. You do need to ready the fine print as many have a limit they will pay for any repairs.