The invention discloses a capsanthin pungency removal process which comprises the following steps: blending alcohol of 40 to 60 degrees to be added to a pungency removal tank and heated to 30 to 40 DEG C; then adding liquid capsicum oleoresin to the pungency removal tank so that the ratio of the alcohol to the liquid capsicum oleoresin is 3 to 2, stirring for 40 minutes, and maintaining a temperature of 30 to 40 DEG C in the stirring process; putting a mixture of alcohol and liquid capsicum oleoresin stirred in the pungency removal tank in a sedimentation tank by a pipeline pump, and precipitating for 24 hours, in which a pigment is positioned above, and capsaicin, pectin, phospholipids and sugar impurities dissolved with the alcohol are positioned below; separating the alcohol and the pigment layered by precipitation; and finally, putting the separated alcohol in a distillation column to be distilled, then recovering the alcohol, putting the remaining impurities in a temporary storage tank, and repeating the process for removing the pungency of the separated pigment. The process provided by the invention is simple and convenient, the pigment loss is slow and the purity is high, and the obtained capsanthin product has the characteristics of high color price, low pungency degree, no smell and the like.