Various techniques are provided to identify anomalous pixels in images captured by imaging devices. In one example, an infrared image frame is received. The infrared image frame is captured by a plurality of infrared sensors based on infrared radiation passed through an optical element. A pixel of the infrared image frame is selected. A plurality of neighborhood pixels of the infrared image frame are selected. Values of the selected pixel and the neighborhood pixels are processed to determine whether the value of the selected pixel exhibits a disparity in relation to the neighborhood pixels that exceeds a maximum disparity associated with a configuration of the optical element and the infrared sensors. The selected pixel is selectively designated as an anomalous pixel based on the processing.