To provide a medium storing and advancing apparatus which orderly piles up bills even when not flat. The medium storing and advancing apparatus includes a tongue piece roller having tongue pieces having the length thereof predetermined. While the tongue piece roller is rotated to slap the rear end of a bill with the tongue pieces to orient the latter downward, the front end of a following bill is superimposed on the downward-oriented rear end of the preceding bill.