An optical sensor system is disclosed. The optical sensor system comprises a panel and a sensing unit. The panel comprises a plurality of transparent areas. The sensing unit locates at one side of the panel and the sensing unit senses a plurality of first light signals reflected by an object and senses a plurality second light signals of an ambient light. The reflected first light signals and the second light signals pass through one of the plurality of transparent areas of the panel. The sensing unit further comprises a light sensor and a plurality of gesture sensors. The light sensor locates at the center of the sensing unit, and the light sensor senses the second light signals. The plurality of gesture sensors surrounds the light sensor, and the gesture sensors senses the reflected first light signals and then produce gesture signals corresponding to motions of the object.