The apparatus comprises a reversible conveyor 13 disposed between a deflection station 23 and an access slot 14. The deflection station allows the dispensing of an empty envelope from a magazine 11 towards the conveyor and the deposition of an envelope containing valuables from the conveyor into a drawer 17. The apparatus further comprises a stamping device at an intermediate position along the length of the conveyor for printing data serially on the envelope during its transfer to the drawer. This is disposed in a safe and is of the sealed type, including two motor driven rollers 141, 142 for inserting the envelope into the drawer. The rollers can be locked in such a way as to close the access to the drawer when the drawer is open. The apparatus is controlled by a microprocessor in two way communication with a central control unit of the apparatus.