A technique for optimizing object recognition is disclosed. The technique includes receiving at least one image of an object and at least one reference image. The technique further includes identifying at least one performance metric corresponding to an object recognition task. The identified performance metric is optimized to generate the corresponding optimized performance metric by determining an optimal subspace based on a determined objective function corresponding to the object recognition task and a difference between the received image and the corresponding reference image. Subsequently, the technique includes comparing the received image with the reference image based on the optimized performance metric for performing the object recognition task.