A real-time color holographical three-dimension display system and method implemented by using digital holographical display theory and regular camera-projector array system are disclosed, which perform space spectrum sample taking of to-be-displayed object O on its arbitrary space spectrum surface S at a sampling density of space sample angle wmn with M*N cameras array anchored on some referencepoint R in the space corresponding to object O, and project each obtained space spectrum view image Imn to corresponding reference surface PR which is necessary to rebuild three-dimension informationof object O using corresponding M*N projectors array at the directions that each space spectrum is taken; realize complete space spectrum output of object O through the function of the holographical function screen placed on reference surface PR of finitely widening the space spectrum of each discrete space spectrum input image information so as to achieve the holographical digital display that aims at resuming the complex wavefront.