Embodiments are disclosed for a method. The method includes receiving feedback decision rules for multiple predictions by a trained machine learning model. generating a feedback rule set based on the feedback decision rules. The method further includes generating an updated training dataset based on an original training dataset and an updated feedback rule set. The updated feedback rule set resolves one or more conflicts of the feedback rule set, and the updated training dataset is configured to train the machine learning model to move a decision boundary. Generating the updated training dataset includes generating multiple updated training instances by applying one of the feedback decision rules to a training instance of the original training dataset.