A directional light sensor may be provided having an array of beam steering elements and an array of corresponding light sensors. Each beam steering element may be configured to direct light from a given angle onto a particular light sensor so that the angular distribution of light may be mapped onto a planar grid of light sensors. Each beam steering element may be formed using holographic, refractive, diffusive or other structures for redirecting a beam of light. An electronic device may be provided having a directional light sensor. The directional light sensor in the electronic device may provide ambient light data or user input data to the electronic device. A test system may be provided having a directional light sensor for gathering ambient light data during testing and manufacturing of an electronic device.