Embodiments include methods performed by a processor of a robotic vehicle for detecting and responding to defects on an on-board imaging device that includes an image sensor. Various embodiments may include causing the imaging device to capture at least one image, determining whether a defect to the imaging device is detected based at least in part on the at least one captured image, and, in response to determining that a defect to the imaging device is detected, identifying an area of the image sensor corresponding to the defect and masking image data received from the identified area of the image sensor.