A method includes receiving an image of a face to match with images of known faces, extracting blocks multiple blocks from the received image, calculating local binary pattern histograms for each block, generating matching scores for each block against block of the images of known faces, determining a top number, N, of matching scores less than the number of blocks, and matching the received image to an image of a known face as a function of the top number of matching scores.