Methods, systems, and computer-readable storage media for training of machine learning (ML) models and inference using the ML models based on distributed data mining in cloud systems, and more particularly for a distributed, tree-based data mining system that uses column-distributed tree-based data mining in a cloud system to support training of and inference using ML models.