Systems and methods are described for generating an enhanced prediction from a 2D and 3D image-based ensemble model. In various embodiments, a computing device can be configured to obtain one or more sets of 2D and 3D images and to standardize each of the 2D and 3D images to allow for comparison and interoperability. Corresponding 2D3D image pairs can be determined from the standardized 2D and 3D pairs where the 2D and 3D images correspond based on a common attribute, such as a similar timestamp or time value. The enhanced prediction can use separate underlying 2D and 3D prediction models where the 2D and 3D images of a 2D3D pair are each input to the respective underlying 2D and 3D prediction models to generate respective 2D and 3D predict actions.