How do I set alpha in statistics?

You select the alpha level based on a number of factors. One consideration is the variability of the characteristic which you are trying to measure. Another, very important criterion is the importance of the decision to be made. If the consequences of the wrong decision are dire then you want a very high alpha, otherwise you may prefer a lower alpha.