A sheet conveying device includes a motor, a first gear, a roller, a second gear, a first frame and a second frame. The first gear is attached to the motor. The second gear is attached to the roller, and in meshing engagement with the first gear. The first frame includes a wall having a side surface. The second frame is provided with: a first abutment portion in abutment with the side surface; and a second abutment portion in abutment with the side surface. The second abutment portion is positioned downstream of the first abutment portion in a second direction that is perpendicular to an axial direction of the roller. An abutment position between the second abutment portion and the side surface is positioned downstream in a first direction along the axial direction of the roller of an abutment position between the first abutment portion and the side surface.