Systems and methods are provided relating to hierarchical machine learning models to identify an anatomical structure of interest and perform diagnostic procedures for a medical diagnostic imaging system. The systems and methods organize a plurality of models into a hierarchical structure based on anatomical structures. The plurality of models are defined by a machine learning algorithm for diagnostic procedures of one or more of the anatomical structures. The systems and methods receive a medical image, identifying an anatomical structure of interest within the medical image, select at least a first model from the plurality of models based on the anatomical structure of interest, and perform a first diagnostic procedure of the anatomical structure of interest based on the first model.