A sheet material conveying device being capable of conveying a folded sheet material that is discharged from an image forming apparatus for forming an image on a sheet material, include: a first conveying path for discharging the folded sheet as it is; a second conveying path branching out from the first conveying path a third conveying path, which branches out from the second conveying path and is connected with the first conveying path, for conveying the sheet material in an opposite direction to a conveying direction of the sheet material in the second conveying path; first switching means for selectively guiding the sheet material to either the first conveying path or the second conveying path; and second switching means for guiding the sheet material guided to the second conveying path to the third conveying path.