The invention relates to a method for acquiring a colorful digital holographic image. The method is technically characterized in that a black and white type area array CCD and multiple recording wavelength lens-free fourier transform hologram recording optical path are used for respectively shooting a single-color digital hologram of an object to be recorded under the irradiation of red, green and blue laser; after the zeroing treatment of the acquired single-color digital holograms is carried out to acquire the corresponding zeroed digital holograms, the median filtering pretreatment is respectively carried out to acquire the corresponding median filtering pretreatment holograms, then the inverse fast fourier transform operation is carried out, and the acquired red, green and blue single-color digital holograms are respectively inputted into a three-layer zero matrix to acquire a colorful digital holographic image of the object to be recorded. According to the method, the position of a reproduced image on a value reconstruction image plane is fixed by the distance between the recorded object on an object plane and a reference point light source during the recording and is not changed with the recording distance. In addition, the method has less constraint on the horizontal size of the object to be recorded and has a larger space-bandwidth product.