Systems and methods for display control based on pupil size in virtual, augmented, and mixed reality (xR) applications. In some embodiments, a method may include: identifying, via a camera mounted to a body a headset facing an eye of a user wearing the headset, a pupil state of the user; communicating an indication of the pupil state to an Information Handling System (IHS) coupled to the headset, wherein the IHS is configured to select a setting based upon the pupil state and transmit an indication of the setting to the headset; and applying the setting, via a controller of the headset, to at least one of: (a) a display mounted on the body of the headset, or (b) an image shown to the user via the display.