Systems and techniques that facilitate automated machine learning model feedback with data capture and synthetic data generation are provided. In various embodiments, a receiver component can receive electronic input identifying a deployed machine learning model. In various aspects, a listener component can retrieve from a data pipeline a data candidate that has been analyzed by the deployed machine learning model, an inference generated by the deployed machine learning model based on the data candidate, and an expert conclusion provided by a subject matter expert based on the data candidate. In various instances, a comparison component can compare the inference with the expert conclusion to determine whether the inference is consistent with the expert conclusion. In various cases, an augmentation component can, in response to a determination that the inference is not consistent with the expert conclusion, generate a set of synthetic training data based on the data candidate.