In a device for picking up tubular workpieces sequentially from a stack, and supplying the same to a subsequent stage, at least one truck is provided so as to be reciprocable between a loading position and an unloading position. In the loading position, the tubular workpieces are stacked up on the truck in an orderly manner into a number of layers, each layer including a plurality of rows each including a number of axially aligned tubular workpieces. A workpiece carrying bar reciprocable between an advanced position passing through the inner bores of a row of the tubular workpieces and a retracting position freeing the row, device for shifting the workpiece carrying bar horizontally and vertically, and devices for controlling the operation of the aforementioned devices are further provided.