An apparatus for conveying containers with a guiding element which contacts the container in at least one area of the peripheral wall thereof and guides the container on a pre-set path, with a driving device which drives the guiding element in order to convey the container, and with a base support element which supports the container at least in part during the conveying in a base region of the container. According to the invention the base support element is vertically displaceable.