An electronic device may be provided with a display. An opaque layer may be formed on an inner surface of a display cover layer in an inactive area of the display. An optical component window may be formed from the opening and may be aligned with an ambient light sensor such as a color ambient light sensor. The color ambient light sensor may have photodetectors on a light detector integrated circuit. Electrostatic shielding may be incorporated into the color ambient light sensor to prevent perturbations in the output of the color ambient light sensor due to the presence of electrostatic charge in the vicinity of the optical component window. The shielding may include a grounded shield layer on a surface of an ambient light sensor support structure that faces the display cover layer and may include a transparent shield layer overlapping the photodetectors.