A method of identifying a false alarm of an optical motion sensor including a plurality of pixel units, includes: receiving pixel values of a testing set of pixel units selected from the plurality of pixel units, and a number of pixels of the testing set is smaller than a number of the plurality of pixel units; and performing a background adjustment operation according to the pixel values of the testing set of pixel units.