The invention provides a character recognition device. The invention aims to provide a character recognition device that is capable of reducing the workload of an operator during character recognition and does not limit the colors used by character frames. The analytic range specified by the operator in the color image data of a note is firstly classified into background, a character frame and a character, the character frame is highly precisely determined according to the classification result, and then the character frame is removed from the color image data from which the background is eliminated, and finally the character recognition is carried out on the residual character.