A rotational and retractable container holding device and conveyor therefor in which a conveyor member is supported in cantilever fashion by support members extending along the conveying path. A plurality of container holding devices extends in a generally horizontal orientation from one side of the conveyor member and include an inner housing slidably mounted on a supporting spindle, an outer housing rotatably mounted with respect to the inner housing and slidably mounted with respect to the spindle, and a container gripping member at the outer end of the outer housing for gripping a container by its neck. The container holding device and its conveyor are particularly suited for receiving newly formed containers and for conveying the containers through a series of bottle forming operations including coating, decorating and so forth.