A peer-review flagging system is operable to train a computer vision model and to generate automated assessment data by performing an inference function on a first medical scan by utilizing the computer vision model. Human assessment data is generated based on a first medical report written by a medical professional in conjunction with review of the first medical scan. First consensus data is generated based on the automated assessment data, the human assessment data, and a first threshold, and the first medical scan is determined to be flagged based on the first consensus data. A second threshold is selected use in generating second consensus data for a second medical scan and a second medical report written by the medical professional in conjunction with review of the second medical scan, and is selected to be stricter than the first threshold based on determining to flag the first medical scan.