A door lock set includes a housing set to be mounted on an outer side of a door, an outside rotary lock unit mounted on the housing set and provided with a rotatable deadbolt spindle, a deadbolt assembly having a deadbolt and a bolt driving mechanism operatively driven by the deadbolt spindle for extending the deadbolt outwardly to lock the door, an outside lever mechanism mounted on the housing set and provided with a rotatable latch spindle, a latch assembly having a latch and a latch driving mechanism operatively driven by the latch spindle for extending the latch outwardly to lock the door, and a link assembly. The link assembly includes a pull shaft connected operably to the outside lever mechanism so as to drive rotatably the latch spindle, a coupling shaft connected pivotally to the pull shaft and mounted pivotally to the housing set, and a driving cam connected operably to the outside rotary lock unit for co-rotation with the deadbolt spindle. The driving cam contacts the coupling shaft and drives the coupling shaft to pivot so as to pull the pull shaft and enable the pull shaft to drive rotatably the latch spindle in order to result in simultaneous retraction of the deadbolt and the latch when the outside rotary lock unit is operated to rotate the deadbolt spindle.