Provided are embodiments for a method for performing colorization of scans. The method includes analyzing a scanner, a scan of an environment to identify one or more patterns within the scan, and obtaining a subset of colorization data of the environment. The method also includes predicting colors for the one or more patterns in the scan based on the subset of colorization data, and assigning the predicted colors to the one or more patterns in the scan to generate a colorized scan. The method includes displaying the colorized scan, wherein the colorized scan combines the scan and the predicted colorization data by assigning the predicted colorization data to the one or more patterns in the scan. Also provided are embodiments for a system for performing the colorization of scans.