A finisher includes: a bundle discharge roller pair; a sheet stacking portion which has a lower stacking tray, an abutment member on which a sheet is abuttable, and a sheet stacking height detecting sensor detecting a height of the sheets on the abutment member side, the sheet stacking portion configured to stack the sheet while lowering the lower stacking tray in accordance with a detection result; tray paddles coming into contact with the discharged sheet in a direction from a top of the sheet, to bring the sheet into abutment on the abutment member; a stacking amount detecting portion detecting a stacking amount of the stacked sheet, and a finisher control portion performing control of reducing a relative distance between the tray paddles and the sheet stacked on the lower stacking tray at the time of transporting of the sheet along with increase in the stacking amount of the sheet.