Image Enhancement Devices With Gaze Tracking

    公开(公告)号:US20250157369A1

    公开(公告)日:2025-05-15

    申请号:US19020750

    申请日:2025-01-14

    Applicant: Apple Inc.

    Abstract: An electronic device may have a display and a camera. Control circuitry in the device can gather information on a user's point of gaze using a gaze tracking system and other sensors, can gather information on the real-world image such as information on content, motion, and other image attributes by analyzing the real-world image, can gather user vision information such as user acuity, contrast sensitivity, field of view, and geometrical distortions, can gather user input such as user preferences and user mode selection commands, and can gather other input. Based on the point-of-gaze information and/or other gathered information, the control circuitry can display the real-world image and supplemental information on the display. The supplemental information can include augmentations such as icons, text labels, and other computer-generated text and graphics overlaid on the real world image and can include enhanced image content such as magnified portions of the real-world image.

    Eyewear with display-optimized lenses

    公开(公告)号:US11803060B1

    公开(公告)日:2023-10-31

    申请号:US17223495

    申请日:2021-04-06

    Applicant: Apple Inc.

    Abstract: Eyewear such as sunglasses may include display-optimized lenses. The lenses may be optimized for viewing an external display and/or for viewing a display in the head-mounted device while also providing sun protection for the user's eyes. The lenses may include a polarizer and a color filter that are designed for a given target display. Lenses that are optimized for a display that emits linearly polarized light may include a linear polarizer. Lenses that are optimized for a display that emits circularly polarized light may include a circular polarizer. The circular polarizer may include a quarter wave plate and a linear polarizer. The color filter may have a transmission spectrum curve with peaks corresponding to the primary colors of the target display so that the color and brightness of display light is preserved while the brightness of sunlight is reduced.

    Electronic device with foveated display and gaze prediction

    公开(公告)号:US10890968B2

    公开(公告)日:2021-01-12

    申请号:US16376329

    申请日:2019-04-05

    Applicant: Apple Inc.

    Abstract: An electronic device may have a foveated display, an eye-tracking system and a head movement detection system. The eye-tracking system may gather information on a user's point of regard on the display while the head movement detection system may capture information regarding the rotation of the observer's head. Based on the point-of-regard information, head rotation information, image data, the type of eye/head movement that is underway, and/or tiredness information, control circuitry in the electronic device may produce image data for a display, with areas of different resolutions and(or) visual quality. A full-resolution and(or) quality portion of the image may overlap the point of regard. One or more lower resolution portions of the image may surround the full-resolution portion. The control circuitry may include a gaze prediction system for predicting the movement of the user's gaze during a saccade.

    Image enhancement devices with gaze tracking

    公开(公告)号:US10747312B2

    公开(公告)日:2020-08-18

    申请号:US16280786

    申请日:2019-02-20

    Applicant: Apple Inc.

    Abstract: An electronic device may have a display and a camera. Control circuitry in the device can gather information on a user's point of gaze using a gaze tracking system and other sensors, can gather information on the real-world image such as information on content, motion, and other image attributes by analyzing the real-world image, can gather user vision information such as user acuity, contrast sensitivity, field of view, and geometrical distortions, can gather user input such as user preferences and user mode selection commands, and can gather other input. Based on the point-of-gaze information and/or other gathered information, the control circuitry can display the real-world image and supplemental information on the display. The supplemental information can include augmentations such as icons, text labels, and other computer-generated text and graphics overlaid on the real world image and can include enhanced image content such as magnified portions of the real-world image.

    Electronic device with adaptive display

    公开(公告)号:US11211030B2

    公开(公告)日:2021-12-28

    申请号:US16629495

    申请日:2018-08-27

    Applicant: Apple Inc.

    Abstract: An electronic device may include a display that displays virtual reality content. Control circuitry may estimate a brightness adaptation state of a user that is wearing the electronic device. The control circuitry may select a tone mapping curve and brightness level for the virtual reality content based on the user's adaptation state. To estimate the user's adaptation state, the control circuitry may gather ambient light information from an ambient light sensor, may gather physiological attributes of the user such as blink rate, pupil size, and eye openness from a camera, and may gather gaze position information from gaze detection circuitry. The control circuitry may optimize the brightness of the display based on the user's current adaptation state, or the control circuitry may shift the brightness of the display away from the user's adaptation level to help guide the adaptation state to the desired level.

    Electronic Device with Adaptive Display

    公开(公告)号:US20210134245A1

    公开(公告)日:2021-05-06

    申请号:US16629495

    申请日:2018-08-27

    Applicant: Apple Inc.

    Abstract: An electronic device may include a display that displays virtual reality content. Control circuitry may estimate a brightness adaptation state of a user that is wearing the electronic device. The control circuitry may select a tone mapping curve and brightness level for the virtual reality content based on the user's adaptation state. To estimate the user's adaptation state, the control circuitry may gather ambient light information from an ambient light sensor, may gather physiological attributes of the user such as blink rate, pupil size, and eye openness from a camera, and may gather gaze position information from gaze detection circuitry. The control circuitry may optimize the brightness of the display based on the user's current adaptation state, or the control circuitry may shift the brightness of the display away from the user's adaptation level to help guide the adaptation state to the desired level.

    Electronic Device with Adaptive Lighting System

    公开(公告)号:US20200098335A1

    公开(公告)日:2020-03-26

    申请号:US16560093

    申请日:2019-09-04

    Applicant: Apple Inc.

    Abstract: A head-mounted device may include a display that generates content and an optical system through which the content is viewable. The head-mounted device may include a lighting system that illuminates a periphery of the optical system. When the user places the device on his or her head in a brightly lit environment, control circuitry may operate the lighting system to provide bright illumination to the user's peripheral vision. The lighting system may gradually decrease in brightness until the user transitions from a bright-adapted state to a dark-adapted state. When the user is partially or fully dark-adapted, the lighting system may be turned off and the display may be turned on. In some arrangements, an ambient light sensor may measure ambient light conditions outside of the electronic device and the control circuitry may control the lighting system based on the ambient lighting conditions.

    Electronic Display Burn-In Detection and Mitigation

    公开(公告)号:US20190080670A1

    公开(公告)日:2019-03-14

    申请号:US15948796

    申请日:2018-04-09

    Applicant: Apple Inc.

    Abstract: Systems, methods, and devices are provided to reduce a likelihood of image burn-in on an electronic display. Such an electronic device may include image processing circuitry and an electronic display. The image processing circuitry may receive image data and analyze the image data for risk of image burn-in and, based at least in part on the analysis of the image data, reduce a risk of image burn-in at least in part by reducing a local maximum pixel luminance value in at least one of a plurality of regions of the image data over time or by reducing a dynamic range headroom of the image data. The electronic display may display the image data with a reduced risk of image burn-in on the pixels of the electronic display.

Patent Agency Ranking