A motion recognition apparatus is provided. The motion recognition apparatus includes an event sensor configured to sense a portion of an object, where a motion occurs, and output events, a color sensor configured to photograph the object and output a color image, a motion area check unit configured to check a motion area which refers to an area where the motion occurs, using spatiotemporal correlations of the events, a shape recognition unit configured to recognize color information and shape information of an area corresponding to the motion area in the color image, a motion estimation unit configured to estimate a motion trajectory using the motion area, the color information, and the shape information, and an operation pattern determination unit configured to determine an operation pattern of the portion where the motion occurs, based on the estimated motion trajectory.