Methods and systems for detecting a vehicle signal through image differencing and filtering are described. A computing device may be configured to receive a sequence of images of an identified vehicle in a vicinity of a given vehicle. The computing device may be configured to determine, based on a comparison of a first image of a pair of images of the sequence of images to a second image of the pair of images, a portion of image data exhibiting a change in color and a change in brightness between the first image and the second image of the pair of images. The computing device may be configured to determine that the portion indicates a light signal for the identified vehicle; and provide instructions to control the given vehicle based on the light signal of the identified vehicle.