A head worn display (HWD) includes a projection system, which projection system in turn may include: a projection surface including a holographic optical element (HOE) centered at a first location; a projector to project light onto a projection area of the projection surface; and a controller to send a control signal to the projector to cause the projector to project an image onto a location shifted from the first location based on a misalignment of a user's line of sight with the first location.