A device for changing styli or probes in a coordinate measuring machine has a magazine (330) with several stations each holding a stylus or probe (320). A holder (310) on the quill of the coordinate measuring machine has an opening (313A), so that kinematic support elements (325) in the holder (310) can be moved underneath cooperating kinematic support elements (324) on the stylus (320). When the holder (310) is engaged in the magazine (330), an extension plate (334) causes the arm (314) to swing out of the way. This arrangement enables the holder (310) to pick up the stylus (320) purely by translational movements of the holder (310), without the need for any separate motor or electromagnet to couple the stylus to the holder.