A system, medium, and method for controlling an operation according to movement. A movement model can be generated based on at least one movement and stored corresponding to a predetermined operation. Movement input by a user may then be compared with the stored movement model, and the predetermined operation can be controlled according to the comparison result. The system may include an inertial sensor sensing movement, a movement probability distribution maker making a probability distribution of movement using stored movement models, a movement comparator determining similarity between a movement model and a movement sensed by the inertial sensor using the probability distribution, and an output unit outputting a operation control signal stored corresponding to a movement model according to a determination result made by the movement comparator.