An optical system is provided. The optical system includes a gaze tracker operative to track a gaze of a user and output data representative of the gaze and a correction portion including multiple spatially varying polarizers. A first polarizer of the spatially varying polarizers has a first control input configured to receive a first control signal indicating whether the first polarizer is to be active or inactive. The first polarizer, when active, provides a first optical correction on light passing through at a location corresponding to a first region of a virtual image. The optical system includes a controller configured to receive the data representative of the gaze, determine, based on the gaze, whether to implement the first optical correction on the light and in response to determining to implement the first optical correction on the light, output the first control signal indicating the first polarizer is to be active.