A paper sheet handling apparatus, includes: an identifying unit 20 which forwards and identifies a paper sheet A that is inserted from an opening portion 22 formed in its front plane; a collecting unit 30 which stores the identified paper sheet A; a paying-out unit 40 which stores a paying-out paper sheet B to be paid out to the opening portion 22 in a certain case; a forwarding unit 50 which forwards the paper sheet A and the paying-out paper sheet B, between each of the identifying unit 20, the collecting unit 30 and the paying-out unit 40; an outer frame 10 which holds each unit of the identifying unit 20 disposed on its front side, the forwarding unit 50 disposed on the inner side from it, the collecting unit 30 disposed below these identifying unit 20 and forwarding unit 50 and on the front side, and the paying-out unit 40 disposed on the inner side from the collecting unit 30, in which to the outer frame 10, at least the collecting unit 30 and the paying-out unit 40 are detachably attached from its front side.