-
公开(公告)号:US20230244308A1
公开(公告)日:2023-08-03
申请号:US18096090
申请日:2023-01-12
Applicant: Apple Inc.
Inventor: Gregory Lutter , Bryce L. Schmidtchen
IPC: G06F3/01 , G06F3/04842
CPC classification number: G06F3/013 , G06F3/04842
Abstract: In one implementation, a method is performed for selecting a UI element with eye tracking-based attention accumulators. The method includes: while a first UI element is currently selected, detecting a gaze direction directed to a second UI element; in response to detecting the gaze direction directed to the second UI element, decreasing a first attention accumulator value associated with the first UI element and increasing a second attention accumulator value associated with the second UI element; in accordance with a determination that the second attention accumulator value exceeds the first attention accumulator value, deselecting the first UI element and selecting the second UI element; and in accordance with a determination that the second attention accumulator value does not exceed the first attention accumulator value, maintaining selection of the first UI element.
-
2.
公开(公告)号:US12008160B2
公开(公告)日:2024-06-11
申请号:US18117997
申请日:2023-03-06
Applicant: Apple Inc.
Inventor: Bryce L. Schmidtchen , Ioana Negoita , Anshu K. Chimalamarri , Gregory Lutter , Thomas J. Moore , Trevor J. McIntyre
IPC: G06F3/01 , G06F3/0482 , G06T7/55 , G06T7/60 , G06T7/73
CPC classification number: G06F3/013 , G06F3/0482 , G06T7/55 , G06T7/60 , G06T7/73 , G06T2200/24 , G06T2207/30201
Abstract: A method is performed at an electronic device with one or more processors, a non-transitory memory, an eye tracker, and a display. The eye tracker receives eye tracking data associated with one or more eyes of a user of the electronic device. The method includes displaying, on the display, a first user interface (UI) element that is associated with a first selection region and a second selection region. While displaying the first UI element, the method includes determining, based on the eye tracking data, that a first targeting criterion is satisfied with respect to the first selection region, and determining, based on the eye tracking data, that a second targeting criterion is satisfied with respect to the second selection region. The method includes selecting the first UI element based at least in part on determining that the first targeting criterion is satisfied and the second targeting criterion is satisfied.
-
公开(公告)号:US20240053611A1
公开(公告)日:2024-02-15
申请号:US18339073
申请日:2023-06-21
Applicant: Apple Inc.
Inventor: Gregory Lutter
CPC classification number: G02B27/0172 , G06T7/74 , G06T19/006 , G02B2027/011 , G02B2027/0138 , G06T2207/10004
Abstract: A camera in a head-mounted device may capture images of a physical environment surrounding the head-mounted device. The images captured by the camera may sometimes be displayed on a transparent display in the head-mounted device. In one example, a video feed from the camera may be displayed on the display at a position that causes the video feed to overlap corresponding portions of the head-mounted device. The video feed may be displayed as part of a camera application, as one example. There may be latency between the capturing of the video feed by the camera and the display of the video feed on the display. To mitigate discomfort caused by latency, each image in the video feed from the camera may be displayed based on a pose of the head-mounted device at the time that image is captured.
-
公开(公告)号:US20240036711A1
公开(公告)日:2024-02-01
申请号:US18339091
申请日:2023-06-21
Applicant: Apple Inc.
Inventor: Gregory Lutter
IPC: G06F3/0484 , G06F3/01
CPC classification number: G06F3/0484 , G06F3/013 , G06F3/012 , G06F2203/04806
Abstract: In a head-mounted device, gaze input may be used to select a user interface element that is displayed on a display. To select a user interface element, the user may target the user interface element with gaze input. Targeting the user interface element with gaze input may cause the user interface element to shift towards a selection region (which may be identified using a displayed selection indicator). The user interface element may continue to shift towards the selection region while being targeted by gaze input. If the user interface element is targeted with gaze input while in the selection region, the user interface element is considered to have been selected and an action associated with the user interface element may be performed. Multiple user interface elements in a list may shift in unison when one of the user interface elements shifts due to gaze input.
-
公开(公告)号:US20240370082A1
公开(公告)日:2024-11-07
申请号:US18644218
申请日:2024-04-24
Applicant: Apple Inc.
Inventor: Guilherme Klink , Andrew Muehlhausen , Gregory Lutter , Luis R. Deliz Centeno , Paulo R. Jansen dos Reis , Peter Burgner , Rahul Nair , Yutaka Yokokawa , Anshu K. Chimalamarri , Ashwin K. Vijay , Benjamin S. Phipps , Brandon K. Schmuck
Abstract: A head-mounted device may be used to control one or more external electronic devices. Gaze input and camera images may be used to determine a point of gaze relative to a display for an external electronic device. The external electronic device may receive information regarding the user's gaze input from the head-mounted device and may highlight one out of multiple user interface elements that is targeted by the gaze input. The head-mounted device may receive input such as keystroke information from an accessory device and relay the input to an external electronic device that is being viewed. The head-mounted device may receive a display configuration request, determine layout information for displays in the physical environment of the head-mounted device, and transmit the layout information to an external device associated with the displays.
-
公开(公告)号:US20240248532A1
公开(公告)日:2024-07-25
申请号:US18272261
申请日:2022-01-11
Applicant: Apple Inc.
Inventor: Thomas G. Salter , Brian W. Temple , Gregory Lutter
CPC classification number: G06F3/013 , G06F3/012 , G06T19/006 , G09G3/001 , G06T2200/24 , G09G2354/00
Abstract: In one implementation, a method for visualizing multi-modal inputs includes: displaying a first user interface element within an extended reality (XR) environment; determining a gaze direction based on first input data; in response to determining that the gaze direction is directed to the first user interface element, displaying a focus indicator with a first appearance in association with the first user interface element; detecting a change in pose of at least one of a head pose or a body pose of a user of the computing system; and, in response to detecting the change of pose, modifying the focus indicator from the first appearance to a second appearance different from the first appearance.
-
7.
公开(公告)号:US20230333643A1
公开(公告)日:2023-10-19
申请号:US18117997
申请日:2023-03-06
Applicant: Apple Inc.
Inventor: Bryce L. Schmidtchen , Ioana Negoita , Anshu K. Chimalamarri , Gregory Lutter , Thomas J. Moore , Trevor J. McIntyre
IPC: G06F3/01 , G06F3/0482 , G06T7/73 , G06T7/55 , G06T7/60
CPC classification number: G06F3/013 , G06F3/0482 , G06T7/73 , G06T7/55 , G06T7/60 , G06T2207/30201 , G06T2200/24
Abstract: A method is performed at an electronic device with one or more processors, a non-transitory memory, an eye tracker, and a display. The eye tracker receives eye tracking data associated with one or more eyes of a user of the electronic device. The method includes displaying, on the display, a first user interface (UI) element that is associated with a first selection region and a second selection region. While displaying the first UI element, the method includes determining, based on the eye tracking data, that a first targeting criterion is satisfied with respect to the first selection region, and determining, based on the eye tracking data, that a second targeting criterion is satisfied with respect to the second selection region. The method includes selecting the first UI element based at least in part on determining that the first targeting criterion is satisfied and the second targeting criterion is satisfied.
-
公开(公告)号:US20230333642A1
公开(公告)日:2023-10-19
申请号:US18115974
申请日:2023-03-01
Applicant: Apple Inc.
Inventor: Anshu K. Chimalamarri , Bryce L. Schmidtchen , Gregory Lutter
CPC classification number: G06F3/013 , G06T7/20 , G06V10/462 , G06V10/56 , G06V40/193
Abstract: A method includes displaying a plurality of visual elements. The method includes determining, based on respective characteristic values of the plurality of visual elements, an expected gaze target that indicates a first display region where a user of the device intends to gaze while the plurality of visual elements is being displayed. The method includes obtaining, via the image sensor, an image that includes a set of pixels corresponding to a pupil of the user of the device. The method includes determining, by a gaze tracker, based on the set of pixels corresponding to the pupil, a measured gaze target that indicates a second display region where the user is measuredly gazing. The method includes adjusting a calibration parameter of the gaze tracker based on a difference between the first display region indicated by the expected gaze target and the second display region indicated by the measured gaze target.
-
公开(公告)号:US12222512B2
公开(公告)日:2025-02-11
申请号:US18339121
申请日:2023-06-21
Applicant: Apple Inc.
Inventor: Gregory Lutter
IPC: G02B27/01
Abstract: A head-mounted device may determine contextual information by analyzing sensor data. The head-mounted device may use computer vision analysis to determine contextual information from images of the physical environment around the head-mounted device. Instead or in addition, the head-mounted device may determine contextual information by receiving state information directly from external equipment within the physical environment. Based on the received state information, the head-mounted device may display content, play audio, change a device setting on the head-mounted device, the external equipment, and/or additional external equipment, and/or may open an application. The head-mounted device may receive the state information in accordance with identifying the external equipment in images of the physical environment. The head-mounted device may receive the state information and then obtain and analyze sensor data to determine contextual information in response to the received state information being insufficient.
-
公开(公告)号:US20240256039A1
公开(公告)日:2024-08-01
申请号:US18631393
申请日:2024-04-10
Applicant: Apple Inc.
Inventor: Gregory Lutter , Bryce L. Schmidtchen
IPC: G06F3/01 , G06F3/04842
CPC classification number: G06F3/013 , G06F3/04842
Abstract: In one implementation, a method is performed for selecting a UI element with eye tracking-based attention accumulators. The method includes: while a first UI element is currently selected, detecting a gaze direction directed to a second UI element; in response to detecting the gaze direction directed to the second UI element, decreasing a first attention accumulator value associated with the first UI element and increasing a second attention accumulator value associated with the second UI element; in accordance with a determination that the second attention accumulator value exceeds the first attention accumulator value, deselecting the first UI element and selecting the second UI element; and in accordance with a determination that the second attention accumulator value does not exceed the first attention accumulator value, maintaining selection of the first UI element.
-
-
-
-
-
-
-
-
-