A controller for controlling an image heating device which includes first and second rollers for heating therebetween a toner image on a sheet, a first rubbing roller for rubbing the first roller, and a second rubbing roller for rubbing the second roller, said controller including a counter configured to count a number of heated sheets; a first executing portion configured to execute rubbing by the first rubbing roller in accordance with an output of the counter; a second executing portion configured to execute rubbing by the second rubbing roller in accordance with an output of the counter; an acquiring portion execution instructions of an image glossiness improving mode operation provided by an operator; and a determination portion configured to determine which roller or rollers of the first second rollers is to be rubbed in accordance with an output of the counter, when the acquiring portion acquires the execution instructions.