A handling device according to an embodiment has an arm, a holder, a storage, and a controller. The arm includes at least one joint. The holder is attached to the arm and is configured to hold an object. The storage stores a function map including at least one of information about holdable positions of the holder and information about possible postures of the holder. The detector is configured to detect information about the object. The controller is configured to generate holdable candidate points on the basis of the information detected by the detector, to search the function map for a position in an environment in which the object is present, the position being associated with the generated holdable candidate points, and to determine a holding posture of the holder on the basis of the searched position. The function map associates a manipulability with each position in the environment in which the object is present. The manipulability is a parameter calculated from at least one joint angle of the holder.