A sensor system provides a plurality of sets of optical sensors configured in a layer and a plurality of sets of optical filters configured in a layer, where the bottom surface of the plurality of sets of optical filters is located proximal to the top surface of the plurality of sets of optical sensors and where a set of optical filters of the plurality of sets of optical filters includes a plurality of optical filters that are arranged in a pattern so that at least some optical filters of the plurality of optical filters are configured to pass light in a different wavelength range. The sensor system provides one or more rejection filters configured as a layer and a first set of optical elements, where the one or more rejection filters and the first set of optical elements are configured in a stack that is located above the top layer of the plurality of sets of optical filters. The sensor system includes one or more processing modules configured to receive an output from each optical sensor of the plurality of sets of optical sensors and generate a spectral response based on the output.