A conveyer belt is looped on rollers placed over and at both ends of a paper sheet storage part and bill holding members for holding bills are fixed onto an outer surface of the conveyer belt at determined interval. The bill holding members themselves have grip force by which the conveyer belt bends inward and the bills are held. When the bill holding members pass over the roller on a reception side, their free ends get apart from the conveyer belt and the bill holding members receive the bills. The bill holding members grip portions near ends of the bills when passing between rollers. When the bill holding members pass under the roller on a release side, their free ends get apart from the conveyer belt. The bill holding members release the bills, allowing the bills to fall onto stacked bills for staking storage.