Adaptive optics (AO) elements in imaging system allow dynamic and precise control over the optical wavefront to reduce uncontrolled wavefront errors in imaging systems. Traditional control of such devices is based on inverting the wavefront function to minimize the RMS wavefront error. However, this approach is not always optimal, particularly when the wavefront error is near or exceeds the limit of the AO element's correction capability. In the current approach, the AO element is instead controlled based on a performance metric that takes into account image processing, and not just RMS wavefront error.