Why did conscription make people angry on both sides of the US Civil War?

Conscription had never been necessary in the US until the Civil War. Each set of draft laws, whether in the South or the North angered many people. One large reason for this were so-called loop holes whereby a man could escape the drafts by paying the governments or finding another man to take one's place.