Systems and methods are provided for selecting feature points within an image. A plurality of candidate feature points are identified in the image. A plurality of feature points are selected for each of the plurality of candidate feature points, a plurality of sets of representative pixels. For each set of representative pixels, a representative value is determined as one of a maximum chromaticity value and a minimum chromaticity value from the set of representative pixels. A score is determined for each candidate feature point from the representative values for the plurality of sets of representative pixels associated with the candidate feature point. The feature points are selected according to the determined scores for the plurality of candidate feature points.