A latch mechanism is provided for retaining a slide rail assembly, which includes first and second slide rails. The latch mechanism includes a latch member movably attached to the second slide rail, a stop member mounted to the first slide rail to engage in the latch member for retaining the second slide rail relative to the first slide rail, and a release member slidably attached to the second slide rail. The latch member includes first and second driven portion at one side thereof, and a cutout. The cutout has a first and second stop surfaces at opposite ends thereof. The release member is capable of pushing the first or second driven portion to release the first or second stop surface from the stop member. A resilient member is placed between the latch member and the second slide rail for returning the latch member to an original position.