A controller controls an operating device. The operating device includes an operating member capable of being pushed by an operator, a biasing unit biasing the operating member in a return direction, a detecting unit configured to detect a distance of movement of the operating member and output a detection signal indicating the distance of movement, and a braking unit configured to brake movement of the operating member. In response to determining, based on the detection signal, that the operating member is pushed into a predetermined retracted position, the controller causes the braking unit to hold the operating member pushed. In response to determining, based on the detection signal, that the operating member is moved in the return direction because of a clearance in a drive transmission system between the operating member and the braking unit, the controller causes the braking unit to stop holding the operating member.