There is provided a banknote handling system including: a reception unit configured to receive a banknote that has been put therein; a recognition unit configured to recognize the banknote that has been received by the reception unit; a storing unit having at least one first cassette configured to store or escrow the banknote that has been recognized by the recognition unit, and at least one second cassette configured to store the banknote that has been recognized by the recognition unit; an operation unit configured to receive a deposit-confirmation instruction for the banknote that has been escrowed in the first cassette; and a control unit configured to cause the banknote that has been recognized by the recognition unit to be escrowed in the first cassette and to cause, when the deposit-confirmation instruction is received by the operation unit, the banknote that has been escrowed in the first cassette to be stored in the second cassette.