A mechanism is provided in a data processing system for distributed tree learning. A source processing instance distributes data record instances to a plurality of model update processing items. The plurality of model update processing items determine candidate leaf splitting actions in a decision tree in parallel based on the data record instances. The plurality of model update processing items send the candidate leaf splitting actions to a plurality of conflict resolve processing items. The plurality of conflict resolve processing items identifies conflict leaf splitting actions. The plurality of conflict resolve processing items applies tree structure changes to the decision tree in the plurality of model update processing items.