A system for classifying a pattern of interest (POI) on a semiconductor specimen is disclosed. The system comprises a processor and memory circuitry. The memory circuitry is configured to obtain a high-resolution image of the POI, and to generate data usable for classifying the POI in accordance with a defectiveness-related classification. To generate the data, a machine learning model is utilized that has been trained in accordance with training samples. The training samples include a high-resolution training image captured by scanning a respective training pattern on a specimen, the respective training pattern being similar to the POI. The training samples also include a label associated with the image, the label being derivative of low-resolution inspection of the respective training pattern.