According to an embodiment, an object handling device includes a base, a manipulator, a first camera, a sensor, a manipulator control unit and a calibration unit. The manipulator is arranged on the base, and includes a movable part and an effector that is arranged on the movable part and acts on an object. The first camera and the sensor are arranged on the manipulator. The manipulator control unit controls the manipulator so that the movable part is moved to a position corresponding to a directed value. The calibration processing unit acquires a first error in a first direction based on an image photographed by the first camera, acquire a second error in a second direction intersecting with the first direction based on a detection result obtained by the sensor, and acquire a directed calibration value with respect to the directed value based on the first error and the second error.