Systems and methods are disclosed herein to detect pixels exhibiting anomalous behavior in captured image frames. In some examples, temporal anomalous behavior may be identified, such as flickering pixels exhibiting large magnitude changes in pixel values that vary rapidly from frame-to-frame. In some examples, spatial anomalous behavior may be identified, such as pixels exhibiting values that deviate from an expected linear response in comparison with other neighbor pixels.