An emotion prediction device mounted on a vehicle includes a control unit. The control unit is capable of executing functions of a first prediction unit configured to predict an emotion of a user based on a facial expression of the user, a second prediction unit configured to predict an emotion of the user based on the motion of the user, and a third prediction unit configured to predict the emotion of the user based on the emotion predicted by the first prediction unit and the emotion predicted by the second prediction unit. The control unit is capable of restricting execution of at least a part of the functions of the first, second, and third prediction units, based on at least a processing load of the control unit.