An apparatus grips tie plates and guides new ties during replacement of worn out ties in the road bed of a railroad track. Mechanical grip elements grip tie plates and secure them against the rail, while an old tie is removed and a new tie is inserted. A spring arrangement automatically self-centers opposing pairs of grip elements. That is, when beginning to grip a tie plate, each pair of mechanical grip elements will automatically center about the tie plate prior to securely gripping the tie plate and without moving the tie plate. The grip elements are supported by an apparatus frame. A frame lifter moves the apparatus frame vertically between an upper and a lower position relative to a vehicle frame of a tie replacer vehicle. A tie guide includes rollers on the underside thereof for minimizing friction between ties being inserted and the tie guide. Sweepers are mounted to the apparatus frame to clean off a tie as it is being inserted.