A handy image data filing apparatus is disclosed, which is made up of a hand scanner as an image data reading device and an IC memory card as an image data storing medium. Image data on an object such as a name card is read by the hand scanner, and filed into the IC memory card. The read data is stored into the IC memory card, together with ID data for identifying the image data to be stored. The ID data is used for retrieving the image data later, and is entered from a keyboard. For retrieval, ID data corresponding to the desired image data is entered from the keyboard. The image data is specified by the ID data entered, and displayed by a liquid crystal display device.