公开(公告)号：US11874530B2

公开(公告)日：2024-01-16

申请号：US16612336

申请日：2018-05-03

Applicant: Apple Inc.

Inventor： Victoria C. Chan ,  Christina G. Gambacorta ,  Graham B. Myhre ,  Hyungryul Choi ,  Nan Zhu ,  Phil M. Hobson ,  William W. Sprague ,  Edward A. Valko ,  Qiong Huang ,  Branko Petljanski ,  Paul V. Johnson ,  Brandon E. Clarke ,  Elijah H. Kleeman

IPC: G02C7/08 ,  A61B3/00 ,  A61B3/032 ,  A61B3/036 ,  G02B6/42 ,  G02B7/02 ,  G02B7/09 ,  G02F1/133 ,  G06F1/16 ,  G02F1/1343

CPC classification number: G02C7/083 ,  A61B3/0008 ,  A61B3/032 ,  A61B3/036 ,  G02B6/4204 ,  G02B7/023 ,  G02B7/09 ,  G02F1/13306 ,  G06F1/163 ,  G02F1/13439

Abstract: A head-mounted display may include a display system and an optical system in a housing. The display system may have displays that produce images. Positioners may be used to move the displays relative to the eye positions of a user's eyes. An adjustable optical system may include tunable lenses such as tunable cylindrical liquid crystal lenses. The displays may be viewed through the lenses when the user's eyes are at the eye positions. A sensor may be incorporated into the head-mounted display to measure refractive errors in the user's eyes. The sensor may include waveguides and volume holograms, and a camera for gathering light that has reflected from the retinas of the user's eyes. Viewing comfort may be enhanced by adjusting display positions relative to the eye positions and/or by adjusting lens settings based on the content being presented on the display and/or measured refractive errors.

公开(公告)号：US20190286227A1

公开(公告)日：2019-09-19

申请号：US16280786

申请日：2019-02-20

Applicant: Apple Inc.

Inventor： Ramin Samadani ,  Christina G. Gambacorta ,  Elijah H. Kleeman ,  Nicolas P. Bonnier

IPC: G06F3/01 ,  G06T7/20 ,  G06K9/00 ,  G06T3/40

Abstract: An electronic device may have a display and a camera. Control circuitry in the device can gather information on a user's point of gaze using a gaze tracking system and other sensors, can gather information on the real-world image such as information on content, motion, and other image attributes by analyzing the real-world image, can gather user vision information such as user acuity, contrast sensitivity, field of view, and geometrical distortions, can gather user input such as user preferences and user mode selection commands, and can gather other input. Based on the point-of-gaze information and/or other gathered information, the control circuitry can display the real-world image and supplemental information on the display. The supplemental information can include augmentations such as icons, text labels, and other computer-generated text and graphics overlaid on the real world image and can include enhanced image content such as magnified portions of the real-world image.

公开(公告)号：US20240029598A1

公开(公告)日：2024-01-25

申请号：US18479965

申请日：2023-10-03

Applicant: Apple Inc.

Inventor： Ramin Samadani ,  Christina G. Gambacorta ,  Elijah H. Kleeman ,  Nicolas P. Bonnier

IPC: G09G3/00 ,  G06F3/01 ,  G06T7/20 ,  G06T3/40 ,  G02B27/01 ,  G02B27/00 ,  G06T19/00 ,  G06V20/20 ,  G06V40/16 ,  G06V40/18

CPC classification number: G09G3/001 ,  G06F3/013 ,  G06F3/017 ,  G06T7/20 ,  G06T3/40 ,  G02B27/0179 ,  G02B27/00 ,  G02B27/017 ,  G06F3/012 ,  G06T19/006 ,  G06V20/20 ,  G06V40/172 ,  G06V40/193 ,  G06T11/001

Abstract: An electronic device may have a display and a camera. Control circuitry in the device can gather information on a user's point of gaze using a gaze tracking system and other sensors, can gather information on the real-world image such as information on content, motion, and other image attributes by analyzing the real-world image, can gather user vision information such as user acuity, contrast sensitivity, field of view, and geometrical distortions, can gather user input such as user preferences and user mode selection commands, and can gather other input. Based on the point-of-gaze information and/or other gathered information, the control circuitry can display the real-world image and supplemental information on the display. The supplemental information can include augmentations such as icons, text labels, and other computer-generated text and graphics overlaid on the real world image and can include enhanced image content such as magnified portions of the real-world image.

公开(公告)号：US20190339770A1

公开(公告)日：2019-11-07

申请号：US16376329

申请日：2019-04-05

Applicant: Apple Inc.

Inventor： Yashas Rai Kurlethimar ,  Andrew B. Watson ,  Nicolas P. Bonnier ,  Mehmet N. Agaoglu ,  Alexander G. Berardino ,  Elijah H. Kleeman

IPC: G06F3/01 ,  G02B27/01

Abstract: An electronic device may have a foveated display, an eye-tracking system and a head movement detection system. The eye-tracking system may gather information on a user's point of regard on the display while the head movement detection system may capture information regarding the rotation of the observer's head. Based on the point-of-regard information, head rotation information, image data, the type of eye/head movement that is underway, and/or tiredness information, control circuitry in the electronic device may produce image data for a display, with areas of different resolutions and(or) visual quality. A full-resolution and(or) quality portion of the image may overlap the point of regard. One or more lower resolution portions of the image may surround the full-resolution portion. The control circuitry may include a gaze prediction system for predicting the movement of the user's gaze during a saccade.

公开(公告)号：US12230173B2

公开(公告)日：2025-02-18

申请号：US18479965

申请日：2023-10-03

Applicant: Apple Inc.

Inventor： Ramin Samadani ,  Christina G. Gambacorta ,  Elijah H. Kleeman ,  Nicolas P. Bonnier

IPC: G09G3/00 ,  G02B27/00 ,  G02B27/01 ,  G06F3/01 ,  G06T3/40 ,  G06T7/20 ,  G06T19/00 ,  G06V20/20 ,  G06V40/16 ,  G06V40/18 ,  G06T5/90 ,  G06T11/00

Abstract: An electronic device may have a display and a camera. Control circuitry in the device can gather information on a user's point of gaze using a gaze tracking system and other sensors, can gather information on the real-world image such as information on content, motion, and other image attributes by analyzing the real-world image, can gather user vision information such as user acuity, contrast sensitivity, field of view, and geometrical distortions, can gather user input such as user preferences and user mode selection commands, and can gather other input. Based on the point-of-gaze information and/or other gathered information, the control circuitry can display the real-world image and supplemental information on the display. The supplemental information can include augmentations such as icons, text labels, and other computer-generated text and graphics overlaid on the real world image and can include enhanced image content such as magnified portions of the real-world image.

公开(公告)号：US11810486B2

公开(公告)日：2023-11-07

申请号：US16927796

申请日：2020-07-13

Applicant: Apple Inc.

Inventor： Ramin Samadani ,  Christina G. Gambacorta ,  Elijah H. Kleeman ,  Nicolas P. Bonnier

IPC: G09G3/00 ,  G06F3/01 ,  G06T7/20 ,  G06T3/40 ,  G02B27/01 ,  G02B27/00 ,  G06T19/00 ,  G06V20/20 ,  G06V40/16 ,  G06V40/18 ,  G06T11/00 ,  G06T5/00

CPC classification number: G09G3/001 ,  G02B27/00 ,  G02B27/017 ,  G02B27/0179 ,  G06F3/012 ,  G06F3/013 ,  G06F3/017 ,  G06T3/40 ,  G06T7/20 ,  G06T19/006 ,  G06V20/20 ,  G06V40/172 ,  G06V40/193 ,  G02B2027/011 ,  G02B2027/014 ,  G02B2027/0112 ,  G02B2027/0118 ,  G02B2027/0138 ,  G02B2027/0187 ,  G06T5/007 ,  G06T11/001 ,  G06T2207/20192 ,  G09G2320/066 ,  G09G2320/0626 ,  G09G2320/0686 ,  G09G2354/00

Abstract: An electronic device may have a display and a camera. Control circuitry in the device can gather information on a user's point of gaze using a gaze tracking system and other sensors, can gather information on the real-world image such as information on content, motion, and other image attributes by analyzing the real-world image, can gather user vision information such as user acuity, contrast sensitivity, field of view, and geometrical distortions, can gather user input such as user preferences and user mode selection commands, and can gather other input. Based on the point-of-gaze information and/or other gathered information, the control circuitry can display the real-world image and supplemental information on the display. The supplemental information can include augmentations such as icons, text labels, and other computer-generated text and graphics overlaid on the real world image and can include enhanced image content such as magnified portions of the real-world image.

公开(公告)号：US20200341547A1

公开(公告)日：2020-10-29

申请号：US16927796

申请日：2020-07-13

Applicant: Apple Inc.

Inventor： Ramin Samadani ,  Christina G. Gambacorta ,  Elijah H. Kleeman ,  Nicolas P. Bonnier

IPC: G06F3/01 ,  G06T7/20 ,  G06K9/00 ,  G06T3/40 ,  G02B27/01 ,  G02B27/00 ,  G06T19/00 ,  G09G3/00

Abstract: An electronic device may have a display and a camera. Control circuitry in the device can gather information on a user's point of gaze using a gaze tracking system and other sensors, can gather information on the real-world image such as information on content, motion, and other image attributes by analyzing the real-world image, can gather user vision information such as user acuity, contrast sensitivity, field of view, and geometrical distortions, can gather user input such as user preferences and user mode selection commands, and can gather other input. Based on the point-of-gaze information and/or other gathered information, the control circuitry can display the real-world image and supplemental information on the display. The supplemental information can include augmentations such as icons, text labels, and other computer-generated text and graphics overlaid on the real world image and can include enhanced image content such as magnified portions of the real-world image.

公开(公告)号：US20250157369A1

公开(公告)日：2025-05-15

申请号：US19020750

申请日：2025-01-14

Applicant: Apple Inc.

Inventor： Ramin Samadani ,  Christina G. Gambacorta ,  Elijah H. Kleeman ,  Nicolas P. Bonnier

IPC: G09G3/00 ,  G02B27/00 ,  G02B27/01 ,  G06F3/01 ,  G06T3/40 ,  G06T5/90 ,  G06T7/20 ,  G06T11/00 ,  G06T19/00 ,  G06V20/20 ,  G06V40/16 ,  G06V40/18

Abstract: An electronic device may have a display and a camera. Control circuitry in the device can gather information on a user's point of gaze using a gaze tracking system and other sensors, can gather information on the real-world image such as information on content, motion, and other image attributes by analyzing the real-world image, can gather user vision information such as user acuity, contrast sensitivity, field of view, and geometrical distortions, can gather user input such as user preferences and user mode selection commands, and can gather other input. Based on the point-of-gaze information and/or other gathered information, the control circuitry can display the real-world image and supplemental information on the display. The supplemental information can include augmentations such as icons, text labels, and other computer-generated text and graphics overlaid on the real world image and can include enhanced image content such as magnified portions of the real-world image.

公开(公告)号：US20240103301A1

公开(公告)日：2024-03-28

申请号：US18530471

申请日：2023-12-06

Applicant: Apple Inc.

Inventor： Victoria C. Chan ,  Christina G. Gambacorta ,  Graham B. Myhre ,  Hyungryul Choi ,  Nan Zhu ,  Phil M. Hobson ,  William W. Sprague ,  Edward A. Valko ,  Qiong Huang ,  Branko Petljanski ,  Paul V. Johnson ,  Brandon E. Clarke ,  Elijah H. Kleeman

IPC: G02C7/08 ,  A61B3/00 ,  A61B3/032 ,  A61B3/036 ,  G02B6/42 ,  G02B7/02 ,  G02B7/09 ,  G02F1/133 ,  G06F1/16

CPC classification number: G02C7/083 ,  A61B3/0008 ,  A61B3/032 ,  A61B3/036 ,  G02B6/4204 ,  G02B7/023 ,  G02B7/09 ,  G02F1/13306 ,  G06F1/163 ,  G02F1/13439

Abstract: A head-mounted display may include a display system and an optical system in a housing. The display system may have displays that produce images. Positioners may be used to move the displays relative to the eye positions of a user's eyes. An adjustable optical system may include tunable lenses such as tunable cylindrical liquid crystal lenses. The displays may be viewed through the lenses when the user's eyes are at the eye positions. A sensor may be incorporated into the head-mounted display to measure refractive errors in the user's eyes. The sensor may include waveguides and volume holograms, and a camera for gathering light that has reflected from the retinas of the user's eyes. Viewing comfort may be enhanced by adjusting display positions relative to the eye positions and/or by adjusting lens settings based on the content being presented on the display and/or measured refractive errors.

公开(公告)号：US10890968B2

公开(公告)日：2021-01-12

申请号：US16376329

申请日：2019-04-05

Applicant: Apple Inc.

Inventor： Yashas Rai Kurlethimar ,  Andrew B. Watson ,  Nicolas P. Bonnier ,  Mehmet N. Agaoglu ,  Alexander G. Berardino ,  Elijah H. Kleeman

IPC: G06F3/01 ,  G02B27/01

Abstract: An electronic device may have a foveated display, an eye-tracking system and a head movement detection system. The eye-tracking system may gather information on a user's point of regard on the display while the head movement detection system may capture information regarding the rotation of the observer's head. Based on the point-of-regard information, head rotation information, image data, the type of eye/head movement that is underway, and/or tiredness information, control circuitry in the electronic device may produce image data for a display, with areas of different resolutions and(or) visual quality. A full-resolution and(or) quality portion of the image may overlap the point of regard. One or more lower resolution portions of the image may surround the full-resolution portion. The control circuitry may include a gaze prediction system for predicting the movement of the user's gaze during a saccade.