Aspects of the present invention disclose a method for color reconstruction of individual detected objects of an underwater image using a library of reference images. The method includes one or more processors obtaining image data of a computing device that includes an underwater image. The method further includes determining a depth measurement corresponding to the underwater image. The method further includes identifying an object of the underwater image based at least in part on a shape of the object. The method further includes reconstructing one or more colors of the object of the underwater image based at least in part on a reference image.