Techniques related to generating dictionaries for example based image processing algorithms are discussed. Such techniques may include iteratively performing example based image processing for candidate look up entries of candidate pairs from a training set database using a current dictionary to determine a test result for each of the look up entries of the candidate pairs and selecting one or more of the candidate pairs for entry in a resultant dictionary based on an error between the test result and a predetermined result entry for the candidate pairs.