An implement for milking animals, such as cows, comprises means adapted to carry teat cups (53, 54) and means for bringing each of the teat cups (53, 54) under a teat of the animal and moving same upwardly. The teat cups (53, 54) are provided with guide means (73) for the purpose of leading a teat cup (53, 54) during its upward movement sidewardly in such a way that the teat cup (53, 54) will not be hampered in its upward movement by a teat cup (53, 54) being already connected to the animal.