A sheet conveying device includes: a conveying unit; a nonvolatile memory; and a controller. The conveying unit is configured to convey a sheet along a conveying path. The controller is configured to control the conveying unit to convey the sheet, store position data in the nonvolatile memory during conveyance of the sheet, determine whether or not the sheet conveying device is started, and drive the conveying unit for an amount determined by the position data if the sheet conveying device is started. The conveying path is divided into a plurality of segments. The position data identifies a segment in which the sheet stays. The more downstream the segment identified by the position data is in the conveying path, the smaller the amount determined by the position data is.