-
公开(公告)号:US11789529B2
公开(公告)日:2023-10-17
申请号:US17569312
申请日:2022-01-05
Applicant: Apple Inc.
Inventor: Yashas Rai Kurlethimar , Can Jin , Nicolas Pierre Marie Frederic Bonnier , Jiaying Wu , Andrew B. Watson
CPC classification number: G06F3/013 , G02B27/0093 , G06V10/462 , G06V40/193 , G09G5/38 , G09G2354/00
Abstract: An electronic device that includes a display and an eye tracker configured to collect eye tracking data regarding a gaze of one or more of a user's eyes across the display is disclosed herein. The electronic device includes processing circuitry that is operatively coupled to the display and configured to foveate one or more areas of the display according to the eye tracking data. If the eye tracking data input is lost, the processing circuitry is configured to recover from the loss of eye tracking data by changing one or more aspects of the foveated areas (e.g., size, resolution, etc.) until a threshold is satisfied. As time elapses since loss of eye tracking, the foveated areas move toward a center or a salient region of the display.
-
公开(公告)号:US11211030B2
公开(公告)日:2021-12-28
申请号:US16629495
申请日:2018-08-27
Applicant: Apple Inc.
Inventor: Nicolas P. Bonnier , Teun R. Baar , Christina G. Gambacorta , Jiaying Wu
Abstract: An electronic device may include a display that displays virtual reality content. Control circuitry may estimate a brightness adaptation state of a user that is wearing the electronic device. The control circuitry may select a tone mapping curve and brightness level for the virtual reality content based on the user's adaptation state. To estimate the user's adaptation state, the control circuitry may gather ambient light information from an ambient light sensor, may gather physiological attributes of the user such as blink rate, pupil size, and eye openness from a camera, and may gather gaze position information from gaze detection circuitry. The control circuitry may optimize the brightness of the display based on the user's current adaptation state, or the control circuitry may shift the brightness of the display away from the user's adaptation level to help guide the adaptation state to the desired level.
-
公开(公告)号:US20210287633A1
公开(公告)日:2021-09-16
申请号:US17174138
申请日:2021-02-11
Applicant: Apple Inc.
Inventor: Yashas Rai Kurlethimar , Can Jin , Nicolas Pierre Marie Frederic Bonnier , Jiaying Wu , Andrew B. Watson
Abstract: An electronic device that includes a display and an eye tracker configured to collect eye tracking data regarding a gaze of one or more of a user's eyes across the display is disclosed herein. The electronic device includes processing circuitry that is operatively coupled to the display and configured to foveate one or more areas of the display according to the eye tracking data. If the eye tracking data input is lost, the processing circuitry is configured to recover from the loss of eye tracking data by changing one or more aspects of the foveated areas (e.g., size, resolution, etc.) until a threshold is satisfied. As time elapses since loss of eye tracking, the foveated areas move toward a center or a salient region of the display.
-
公开(公告)号:US11119624B2
公开(公告)日:2021-09-14
申请号:US16366503
申请日:2019-03-27
Applicant: Apple Inc.
Inventor: Paul V. Johnson , Ahmad Rahmati , Chaohao Wang , Cheng Chen , Graham B. Myhre , Jiaying Wu , Paolo Sacchetto , Sheng Zhang , Yunhui Hou , Xiaokai Li , Tim H. Cornelissen
IPC: G06F3/0485 , G06F3/0481 , G06F3/0488 , G06F3/0484 , G06F3/01
Abstract: An electronic device may include a display for displaying image content to a user and dynamic image stabilization circuitry for dynamically compensating the image content if the device is moving unpredictably to help keep the image content aligned with the user's gaze. The electronic device may include sensors for detecting the displacement of the device. The dynamic image stabilization circuitry may include a usage scenario detection circuit and a content displacement compensation calculation circuit. The usage scenario detection circuit receives data from the sensors and infers a usage scenario based on the sensor data. The content displacement compensation calculation circuit uses the inferred usage scenario to compute a displacement amount by which to adjust image content. When motion stops, the image content may gradually drift back to the center of the display.
-
公开(公告)号:US20210134245A1
公开(公告)日:2021-05-06
申请号:US16629495
申请日:2018-08-27
Applicant: Apple Inc.
Inventor: Nicolas P. Bonnier , Teun R. Baar , Christina G. Gambacorta , Jiaying Wu
Abstract: An electronic device may include a display that displays virtual reality content. Control circuitry may estimate a brightness adaptation state of a user that is wearing the electronic device. The control circuitry may select a tone mapping curve and brightness level for the virtual reality content based on the user's adaptation state. To estimate the user's adaptation state, the control circuitry may gather ambient light information from an ambient light sensor, may gather physiological attributes of the user such as blink rate, pupil size, and eye openness from a camera, and may gather gaze position information from gaze detection circuitry. The control circuitry may optimize the brightness of the display based on the user's current adaptation state, or the control circuitry may shift the brightness of the display away from the user's adaptation level to help guide the adaptation state to the desired level.
-
公开(公告)号:US10733942B2
公开(公告)日:2020-08-04
申请号:US16044408
申请日:2018-07-24
Applicant: Apple Inc.
Inventor: Francisco H. Imai , Chi Zhang , Adria Fores Herranz , Jiaying Wu , Arthur L. Spence , Marc Albrecht
Abstract: Aspects of the subject technology relate to electronic devices with displays and ambient light sensors. An electronic device modifies the color of images to be displayed based on measured ambient light color. The modification is performed in a perceptually uniform color space and includes a determination of a bleaching effect of reflected ambient light, and a determination of a color correction factor to be applied within the perceptually uniform color space, based on the determined bleaching effect. The modification may also include an application of a strength factor that mitigates out-of-gamut colors in color compensated images.
-
公开(公告)号:US20200098335A1
公开(公告)日:2020-03-26
申请号:US16560093
申请日:2019-09-04
Applicant: Apple Inc.
Inventor: Cheng Chen , Nicolas P. Bonnier , Graham B. Myhre , Jiaying Wu
Abstract: A head-mounted device may include a display that generates content and an optical system through which the content is viewable. The head-mounted device may include a lighting system that illuminates a periphery of the optical system. When the user places the device on his or her head in a brightly lit environment, control circuitry may operate the lighting system to provide bright illumination to the user's peripheral vision. The lighting system may gradually decrease in brightness until the user transitions from a bright-adapted state to a dark-adapted state. When the user is partially or fully dark-adapted, the lighting system may be turned off and the display may be turned on. In some arrangements, an ambient light sensor may measure ambient light conditions outside of the electronic device and the control circuitry may control the lighting system based on the ambient lighting conditions.
-
公开(公告)号:US20190317659A1
公开(公告)日:2019-10-17
申请号:US16366503
申请日:2019-03-27
Applicant: Apple Inc.
Inventor: Paul V. Johnson , Ahmad Rahmati , Chaohao Wang , Cheng Chen , Graham B. Myhre , Jiaying Wu , Paolo Sacchetto , Sheng Zhang , Yunhui Hou , Xiaokai Li , Tim H. Cornelissen
IPC: G06F3/0484 , G06F3/01 , G06F3/0481
Abstract: An electronic device may include a display for displaying image content to a user and dynamic image stabilization circuitry for dynamically compensating the image content if the device is moving unpredictably to help keep the image content aligned with the user's gaze. The electronic device may include sensors for detecting the displacement of the device. The dynamic image stabilization circuitry may include a usage scenario detection circuit and a content displacement compensation calculation circuit. The usage scenario detection circuit receives data from the sensors and infers a usage scenario based on the sensor data. The content displacement compensation calculation circuit uses the inferred usage scenario to compute a displacement amount by which to adjust image content. When motion stops, the image content may gradually drift back to the center of the display.
-
公开(公告)号:US20180330695A1
公开(公告)日:2018-11-15
申请号:US15907078
申请日:2018-02-27
Applicant: Apple Inc.
Inventor: Teun R. Baar , Marc Albrecht , Tobias Jung , Jiaying Wu , Nicolas P. Bonnier , Nathaniel C. Begeman , Ian C. Hendry
CPC classification number: G09G5/10 , G06K9/6202 , G09G5/02 , G09G2320/0276 , G09G2360/144 , G09G2360/16
Abstract: An electronic device may be provided with a display. A content generator may generate frames of image data to be displayed on the display. Control circuitry in the electronic device may be used in implementing a tone mapping engine. The tone mapping engine may display content from the content generator on the display in accordance with a content-luminance-to-display luminance mapping. The content-luminance-to-display-luminance mapping is characterized by tone mapping parameters such as a black level, a reference white level, and a specular white level. The tone mapping engine may adjust the tone mapping parameters based on ambient light levels, user brightness settings, content statistics, and display characteristics.
-
公开(公告)号:US20180164882A1
公开(公告)日:2018-06-14
申请号:US15835046
申请日:2017-12-07
Applicant: Apple Inc.
Inventor: Paul V. Johnson , Yuan Chen , Bryan W. Posner , Cheng Chen , Chia Hsuan Tai , Jiaying Wu , Robert Y. Cao , Shih-Chyuan Fan Jiang , Shih-Wei Chang , Xiaokai Li , Zhibing Ge , Dinesh C. Mathew
IPC: G06F3/01 , G02F1/00 , G02F1/1333 , G02F1/1335
CPC classification number: G06F3/013 , G02F1/0045 , G02F1/0063 , G02F1/13338 , G02F1/133536 , G02F1/13475 , G06F3/01
Abstract: An electronic device may have a display. Input-output circuitry in the electronic device may be used to gather input from a viewer of the display. The input-output circuitry may include a gaze tracking system that gathers point-of-gaze information, vergence information, and head position information, may be a biometric sensor, may be an input device such as a button or touch sensor, may capture hand gestures, and/or may gather other information. The display may include a pixel array for producing images. An adjustable reflectance and transmittance layer may overlap the pixel array. Control circuitry in the electronic device may individually adjust different areas of the adjustable reflectance and transmittance layer. The control circuitry may place each area in a reflective mirror more or in a content-displaying mode and may move the areas in response to the information.
-
-
-
-
-
-
-
-
-