A paper delivery device includes a shift frame movable in a second direction perpendicular or substantially perpendicular to a first direction along which paper is delivered to outside, a driver that moves the shift frame in the second direction, a drive roller with a first outer peripheral surface extending in the second direction and supported by the shift frame such that the drive roller is rotatable about a first shaft parallel or substantially parallel to the second direction, a first driven roller with a second outer peripheral surface extending in the second direction and contactable with the first outer peripheral surface at a first contact position, the first driven roller supported by the shift frame such that the first driven roller is rotatable about a second shaft parallel or substantially parallel to the second direction following the rotation of the drive roller, the first driven roller being rotated in a state where the paper is nipped between the first outer peripheral surface and the second outer peripheral surface thus transporting the paper in the first direction, and a second driven roller with a third outer peripheral surface extending in the second direction and contactable with the first outer peripheral surface at a second contact position downstream of the first contact position in the first direction, the second driven roller being supported by the shift frame such that the second driven roller is rotated about a third shaft disposed parallel or substantially parallel to the second direction following the rotation of the drive roller, the second driven roller being rotated in a state where the paper which is nipped between the first outer peripheral surface and the second outer peripheral surface is nipped by the first outer peripheral surface and the third outer peripheral surface thus transporting the paper in the first direction.