-
公开(公告)号:US10379612B1
公开(公告)日:2019-08-13
申请号:US15826367
申请日:2017-11-29
Applicant: Apple Inc.
Inventor: Nicolas P. Bonnier , William Riedel , Jiaying Wu , Martin P. Grunthaner , Seyed Hesameddin Najafi Shoushtari
Abstract: An electronic device may have a display and a gaze tracking system. Control circuitry in the electronic device can produce a saliency map in which items of visual interest are identified among content that has been displayed on a display in the electronic device. The saliency map may identify items such as selectable buttons, text, and other items of visual interest. User input such as mouse clicks, voice commands, and other commands may be used by the control circuitry in identifying when a user is gazing on particular items within the displayed content. Information on a user's actual on-screen point of gaze that is inferred using the saliency map information and user input can be compared to measured eye position information from the gaze tracking system to calibrate the gaze tracking system during normal operation of the electronic device.
-
公开(公告)号:US20180350047A1
公开(公告)日:2018-12-06
申请号:US15667099
申请日:2017-08-02
Applicant: Apple Inc.
Inventor: Teun R. Baar , Jiaying Wu , Nicolas P. Bonnier , Garrett M. Johnson , Paul M. Hubel
IPC: G06T5/00
CPC classification number: G06T5/009 , G06T5/20 , G06T5/50 , G06T2207/10024 , G06T2207/20028 , G06T2207/20208
Abstract: Systems, methods, and computer readable media to improve the operation of electronic display systems are disclosed. Techniques for inverse tone mapping operations for selected standard dynamic range (SDR) images are described. The converted images may be presented on high dynamic range (HDR) displays so as to increase a user's viewing experience (through an expanded dynamic range) while preserving the artistic content of the displayed information. Techniques disclosed herein selectively transform SDR images to HDR images by determining if the SDR images were created from HDR images (e.g., through the fusion of multiple SDR images) and if their quality is such as to permit the conversion without introducing unwanted visual artifacts. The proposed techniques apply a sigmoidal inverse tone mapping function configured to provide a perceptual-based tone mapping. Values for the function's tuning parameters may be set based on what may be determined about the original HDR-to-SDR mapping operation.
-
公开(公告)号:US12230173B2
公开(公告)日:2025-02-18
申请号:US18479965
申请日:2023-10-03
Applicant: Apple Inc.
Inventor: Ramin Samadani , Christina G. Gambacorta , Elijah H. Kleeman , Nicolas P. Bonnier
IPC: G09G3/00 , G02B27/00 , G02B27/01 , G06F3/01 , G06T3/40 , G06T7/20 , G06T19/00 , G06V20/20 , G06V40/16 , G06V40/18 , G06T5/90 , G06T11/00
Abstract: An electronic device may have a display and a camera. Control circuitry in the device can gather information on a user's point of gaze using a gaze tracking system and other sensors, can gather information on the real-world image such as information on content, motion, and other image attributes by analyzing the real-world image, can gather user vision information such as user acuity, contrast sensitivity, field of view, and geometrical distortions, can gather user input such as user preferences and user mode selection commands, and can gather other input. Based on the point-of-gaze information and/or other gathered information, the control circuitry can display the real-world image and supplemental information on the display. The supplemental information can include augmentations such as icons, text labels, and other computer-generated text and graphics overlaid on the real world image and can include enhanced image content such as magnified portions of the real-world image.
-
公开(公告)号:US20240385454A1
公开(公告)日:2024-11-21
申请号:US18662641
申请日:2024-05-13
Applicant: Apple Inc.
Inventor: Ricardo J. Motta , Brett D. Miller , Chad A. Bronstein , Bennett S. Wilburn , Branko Petljanski , Mahmut C. Orsan , David W. Lum , Edward A. Valko , Graham B. Myhre , Wonjae Choi , Manohar B. Srikanth , Michael Slootsky , Nicolas P. Bonnier , Jiaying Wu , ZhiBing Ge , William W. Sprague , Bertrand Nepveu , Michael J. Rockwell , Edward S. Huo , Marinus Meursing , Timothy Y. Chang , Katharina Buckl
IPC: G02B27/01 , G02B7/14 , G02B27/00 , G06F3/01 , H04N13/361
Abstract: A head-mountable display device includes a housing defining a front opening and a rear opening, a display screen disposed in the front opening, a display assembly disposed in the rear opening, a first securement strap coupled to the housing, the first securement strap including a first electronic component, a second securement strap coupled to the housing, the second securement strap including a second electronic component, and a securement band extending between and coupled to the first securement strap and the second securement strap.
-
公开(公告)号:US11810486B2
公开(公告)日:2023-11-07
申请号:US16927796
申请日:2020-07-13
Applicant: Apple Inc.
Inventor: Ramin Samadani , Christina G. Gambacorta , Elijah H. Kleeman , Nicolas P. Bonnier
IPC: G09G3/00 , G06F3/01 , G06T7/20 , G06T3/40 , G02B27/01 , G02B27/00 , G06T19/00 , G06V20/20 , G06V40/16 , G06V40/18 , G06T11/00 , G06T5/00
CPC classification number: G09G3/001 , G02B27/00 , G02B27/017 , G02B27/0179 , G06F3/012 , G06F3/013 , G06F3/017 , G06T3/40 , G06T7/20 , G06T19/006 , G06V20/20 , G06V40/172 , G06V40/193 , G02B2027/011 , G02B2027/014 , G02B2027/0112 , G02B2027/0118 , G02B2027/0138 , G02B2027/0187 , G06T5/007 , G06T11/001 , G06T2207/20192 , G09G2320/066 , G09G2320/0626 , G09G2320/0686 , G09G2354/00
Abstract: An electronic device may have a display and a camera. Control circuitry in the device can gather information on a user's point of gaze using a gaze tracking system and other sensors, can gather information on the real-world image such as information on content, motion, and other image attributes by analyzing the real-world image, can gather user vision information such as user acuity, contrast sensitivity, field of view, and geometrical distortions, can gather user input such as user preferences and user mode selection commands, and can gather other input. Based on the point-of-gaze information and/or other gathered information, the control circuitry can display the real-world image and supplemental information on the display. The supplemental information can include augmentations such as icons, text labels, and other computer-generated text and graphics overlaid on the real world image and can include enhanced image content such as magnified portions of the real-world image.
-
公开(公告)号:US11030728B2
公开(公告)日:2021-06-08
申请号:US16127569
申请日:2018-09-11
Applicant: Apple Inc.
Inventor: Ramin Samadani , Gregory B. Abbas , Teun R. Baar , Nicolas P. Bonnier , Victor M. de Araujo Oliveira , Zuo Xia
Abstract: An electronic device may be provided with a display. A content generator such as a camera may capture images in high dynamic range mode or standard dynamic range mode. The images may have associated image metadata such as face detection information, camera settings, color and luminance histograms, and image classification information. Control circuitry in the electronic device may determine tone mapping parameters for the captured images based on the image metadata. The tone mapping parameters for a given image may be stored with the image in the metadata file. When it is desired to display the image, the control circuitry may apply a tone mapping process to the image according to the stored tone mapping parameters. The algorithm that is used to determine tone mapping parameters based on image metadata may be based on user preference data gathered from a population of users.
-
27.
公开(公告)号:US10963998B1
公开(公告)日:2021-03-30
申请号:US16705025
申请日:2019-12-05
Applicant: Apple Inc.
Inventor: Teun R. Baar , Jiaying Wu , Nicolas P. Bonnier , Ramin Samadani
IPC: G06T5/00 , G06F3/01 , G06T5/50 , G06F3/0481 , G06F3/0484
Abstract: An electronic device may be provided with a display. Standard and high dynamic range content may be produced by content generators operating on control circuitry. Standard dynamic range content and high dynamic range content may be simultaneously displayed. Tone mapping parameters may be produced by a tone mapping engine for use in displaying the standard and high dynamic range content. The tone mapping parameters may be selected based on factors such as ambient light level, user brightness setting, content statistics, display characteristics, point of gaze information, power consumption information, and per-window information. Tone mapping parameters may be selected to accommodate simultaneous display of standard and high dynamic range content. Tone mapping parameters may be temporarily modified in response to a user's point of gaze switching between standard dynamic range content and high dynamic range content.
-
28.
公开(公告)号:US10917583B2
公开(公告)日:2021-02-09
申请号:US16040400
申请日:2018-07-19
Applicant: Apple Inc.
Inventor: Teun R. Baar , Nicolas P. Bonnier , Adria Fores Herranz , Mahesh B. Chappalli
Abstract: Aspects of the subject technology relate to display circuitry for displaying both standard dynamic range (SDR) and high dynamic range (HDR) content with an HDR display. The subject technology provides a headroom-based transfer function that maintains the contrast of the SDR content whether the display is operated in the SDR or HDR mode.
-
公开(公告)号:US20200341547A1
公开(公告)日:2020-10-29
申请号:US16927796
申请日:2020-07-13
Applicant: Apple Inc.
Inventor: Ramin Samadani , Christina G. Gambacorta , Elijah H. Kleeman , Nicolas P. Bonnier
Abstract: An electronic device may have a display and a camera. Control circuitry in the device can gather information on a user's point of gaze using a gaze tracking system and other sensors, can gather information on the real-world image such as information on content, motion, and other image attributes by analyzing the real-world image, can gather user vision information such as user acuity, contrast sensitivity, field of view, and geometrical distortions, can gather user input such as user preferences and user mode selection commands, and can gather other input. Based on the point-of-gaze information and/or other gathered information, the control circuitry can display the real-world image and supplemental information on the display. The supplemental information can include augmentations such as icons, text labels, and other computer-generated text and graphics overlaid on the real world image and can include enhanced image content such as magnified portions of the real-world image.
-
公开(公告)号:US10199012B2
公开(公告)日:2019-02-05
申请号:US15427947
申请日:2017-02-08
Applicant: Apple Inc.
Inventor: Roy J. E. M. Raymann , Nicolas P. Bonnier , Jonathan T. Varbel , Lu Zhang
IPC: G09G5/10 , G06F3/01 , G09G3/20 , G06F3/0484
Abstract: Parameters of a display may be adjusted in response to accessing a time value corresponding to an electronic device that includes the display. A brightness value of the display may be adjusted based on the time value to maintain a display characteristic value within a predefined range and below a threshold. The display characteristic value may be independently controllable by one of the brightness or the color temperature of the display. A set of red green blue (RGB) color values of the display may be adjusted independent of the adjustment to the brightness value to maintain the display characteristic value within the predefined range and below the threshold while maintaining the brightness value of the display. In some examples, the RGB color values of the display may be adjusted at approximately the same time as the adjustment of the set of RGB color values of the display is performed.
-
-
-
-
-
-
-
-
-