A tie plate fastener system for connecting a pair of spaced rails to a tie. The system includes a metallic channel tie of U-shaped cross section with the legs thereof opening downwardly and the base thereof having at each end at least one pair of openings spaced from the edges of a rail base when in position on the tie. A pair of tie plates for each rail is located on either side thereof, each plate having openings therethrough in positions corresponding to the openings in the base of the tie, and a single fastening means extends through each of the pairs of openings for securing each pair of tie plates, and thus its respective rail, to the tie.