A manual operating device includes a display input device, an arm position sensing section, a physical position sensing section and a control section. The display input device includes a display section that displays an operating screen, and a touch panel. The arm position detecting section detects an arm of an operator at a plurality of positions in a right and left direction. The physical position sensing section detects a body of the operator at a plurality of positions in the right and left direction. The control section makes a determination as to whether it is right hand or left hand that the operator has touched the display input device with based on results detected by the arm position sensing section and the physical position sensing section, and then controls display of the display section based on the result of the right-or-left determination.