This document relates to an optical device that uses adaptive optics as part of an optical system. The adaptive optics can be used to correct light rays that correspond to a portion of an eye box based on information received from an eye-tracking unit, and can also correct for aberrations in the optics in the optical device. The adaptive optics include corrective elements that can be modified using modifying elements to correct the angle of light rays, such that rays associated with a specific pupil position and gaze direction of a user's eye can be made parallel and ensure a high quality image is viewed by the user.