Alpha has more than one meaning in psychology.
In research methods, alpha is the probability of rejecting a true null hypothesis. Alpha is often set at .05 in psychological studies.
Alpha is also short for Cronbach's alpha, which is also called Coefficient alpha, which is a value that describes the degree of internal consistency among the items in a test or questionnaire. Some authors use the Greek letter for alpha (a).