According to one embodiment, a cargo handling apparatus includes a first mechanism, a second mechanism, a holding unit, a third mechanism, a fourth mechanism and a conveyor. The first mechanism is movable in a first direction. The second mechanism is connected to the first mechanism and is movable on a first horizontal plane intersecting the first direction. The holding unit is connected to the second mechanism and holds an object to be picked up. The third mechanism is arranged below the first mechanism, the second mechanism and the holding unit, and is movable in the first direction. The fourth mechanism is connected to the third mechanism and is movable on a second horizontal plane opposed to the first horizontal plane. The conveyor is connected to the fourth mechanism, and loads and conveys the object held by the holding unit.