Provided is an apparatus and method of recognizing a motion that is capable of performing a pointing function and a character input function using motions sensed by an optical sensor and an inertial sensor. The apparatus includes an inertial sensor sensing a first motion by using at least one of acceleration and angular velocity that are generated by an input motion; an optical sensor sensing a second motion by using reflection of light due to the motion; a locus calculating unit calculating the locus of the motion on the basis of the locus of the first motion and the locus of the second motion; and a communication unit transmitting the calculated locus of the motion.