An optical processing apparatus and a light source luminance adjustment method adapted to detect a rotational displacement and a pressing state are provided. The optical processing apparatus includes a light source unit, a processing unit, and an image sensing unit, wherein the processing unit is electrically connected to the light source unit and the image sensing unit. The light source unit provides a beam of light. The processing unit defines a frame rate, defines a plurality of time instants within a time interval, and sets the light source unit to a luminance value at each of the time instants. A length of the time interval is shorter than the reciprocal of the frame rate. The luminance values are different and are within a range. The image sensing unit captures an image by an exposure time length at each of the time instants, wherein the exposure time lengths are the same.