公开(公告)号：US20240355081A1

公开(公告)日：2024-10-24

申请号：US18760288

申请日：2024-07-01

Applicant: Apple Inc.

Inventor： Bryce L. Schmidtchen ,  Bryan Cline ,  Charles O. Goddard ,  Michael I. Weinstein ,  Tsao-Wei Huang ,  Tobias Rick ,  Vedant Saran ,  Alexander Menzies ,  Alexandre Da Veiga

IPC: G06T19/20 ,  G06T5/70 ,  G06T15/04 ,  G06T15/10 ,  G06T19/00

CPC classification number: G06T19/20 ,  G06T5/70 ,  G06T15/04 ,  G06T15/10 ,  G06T19/006 ,  G06T2219/2004

Abstract: Various implementations provide a view of a 3D environment including a portal for viewing a stereo item (e.g., a photo or video) positioned a distance behind the portal. One or more visual effects are provided based on texture of one or more portions of the stereo item, e.g., texture at cutoff or visible edges of the stereo item. The effects change the appearance of the stereo item or the portal itself, e.g., improving visual comfort issues by minimizing window violations or otherwise enhancing the viewing experience. Various implementations provide a view of a 3D environment including an immersive view of a stereo item without using portal. Such a visual effect may be provided to partially obscure the surrounding 3D environment.

公开(公告)号：US12008160B2

公开(公告)日：2024-06-11

申请号：US18117997

申请日：2023-03-06

Applicant: Apple Inc.

Inventor： Bryce L. Schmidtchen ,  Ioana Negoita ,  Anshu K. Chimalamarri ,  Gregory Lutter ,  Thomas J. Moore ,  Trevor J. McIntyre

IPC: G06F3/01 ,  G06F3/0482 ,  G06T7/55 ,  G06T7/60 ,  G06T7/73

CPC classification number: G06F3/013 ,  G06F3/0482 ,  G06T7/55 ,  G06T7/60 ,  G06T7/73 ,  G06T2200/24 ,  G06T2207/30201

Abstract: A method is performed at an electronic device with one or more processors, a non-transitory memory, an eye tracker, and a display. The eye tracker receives eye tracking data associated with one or more eyes of a user of the electronic device. The method includes displaying, on the display, a first user interface (UI) element that is associated with a first selection region and a second selection region. While displaying the first UI element, the method includes determining, based on the eye tracking data, that a first targeting criterion is satisfied with respect to the first selection region, and determining, based on the eye tracking data, that a second targeting criterion is satisfied with respect to the second selection region. The method includes selecting the first UI element based at least in part on determining that the first targeting criterion is satisfied and the second targeting criterion is satisfied.

公开(公告)号：US20240302898A1

公开(公告)日：2024-09-12

申请号：US18651151

申请日：2024-04-30

Applicant: Apple Inc.

Inventor： Bryce L. Schmidtchen ,  Ioana Negoita ,  Anshu K. Chimalamarri ,  Gregory Lutter ,  Thomas J. Moore ,  Trevor J. McIntyre

IPC: G06F3/01 ,  G06F3/0482 ,  G06T7/55 ,  G06T7/60 ,  G06T7/73

CPC classification number: G06F3/013 ,  G06F3/0482 ,  G06T7/55 ,  G06T7/60 ,  G06T7/73 ,  G06T2200/24 ,  G06T2207/30201

Abstract: A method is performed at an electronic device with one or more processors, a non-transitory memory, and a display. The method includes displaying, on the display, a first user interface (UI) element that is associated with a first selection region and a second selection region. The method includes, while displaying the first UI element, determining, based on eye tracking data, that a targeting criterion is satisfied with respect to the first selection region or the second selection region. The eye tracking data is associated with one or more eyes of a user of the electronic device. The method includes, while displaying the first UI element, selecting the first UI element based at least in part on determining that the targeting criterion is satisfied.

公开(公告)号：US11983316B2

公开(公告)日：2024-05-14

申请号：US18096090

申请日：2023-01-12

Applicant: Apple Inc.

Inventor： Gregory Lutter ,  Bryce L. Schmidtchen

IPC: G06F3/01 ,  G06F3/04842

CPC classification number: G06F3/013 ,  G06F3/04842

Abstract: In one implementation, a method is performed for selecting a UI element with eye tracking-based attention accumulators. The method includes: while a first UI element is currently selected, detecting a gaze direction directed to a second UI element; in response to detecting the gaze direction directed to the second UI element, decreasing a first attention accumulator value associated with the first UI element and increasing a second attention accumulator value associated with the second UI element; in accordance with a determination that the second attention accumulator value exceeds the first attention accumulator value, deselecting the first UI element and selecting the second UI element; and in accordance with a determination that the second attention accumulator value does not exceed the first attention accumulator value, maintaining selection of the first UI element.

公开(公告)号：US20240019928A1

公开(公告)日：2024-01-18

申请号：US18374125

申请日：2023-09-28

Applicant: Apple Inc.

Inventor： Thomas G. Salter ,  Anshu K. Chimalamarri ,  Bryce L. Schmidtchen ,  Devin W. Chalmers ,  Gregory Lutter

IPC: G06F3/01 ,  G06F1/16

CPC classification number: G06F3/012 ,  G06F3/013 ,  G06F1/163

Abstract: Various implementations disclosed herein include devices, systems, and methods for using a gaze vector and head pose information to effectuate a user interaction with a virtual object. In some implementations, a device includes a sensor for sensing a head pose of a user, a display, one or more processors, and a memory. In various implementations, a method includes displaying a set of virtual objects. Based on a gaze vector, it is determined that a gaze of the user is directed to a first virtual object of the set of virtual objects. A head pose value corresponding to the head pose of the user is obtained. An action relative to the first virtual object is performed based on the head pose value satisfying a head pose criterion.

公开(公告)号：US20250071248A1

公开(公告)日：2025-02-27

申请号：US18948235

申请日：2024-11-14

Applicant: Apple Inc.

Inventor： Alexander Menzies ,  Tobias Rick ,  Alexandre Da Veiga ,  Bryce L. Schmidtchen ,  Vedant Saran ,  Bryan Cline ,  Michael I. Weinstein ,  Tsao-Wei Huang

IPC: H04N13/20 ,  G06T5/50 ,  G06T11/60

Abstract: Embodiments disclosed herein are directed to devices, systems, and methods for separately processing an image stream to generate a first set of images for display by a set of displays and a second set of images for storage or transfer as part of a media capture event. Specifically, a first set of images from an image stream may be used to generate a first set of transformed images, and these transformed images may be displayed on a set of displays. A second set of images may be selected from the image stream in response to a capture request associated with a media capture event, and the second set of images may be used to generate a second set of transformed images. A set of output images may be generated from the second set of transformed images, and the set of output images may be stored or transmitted for later viewing.

公开(公告)号：US20240406365A1

公开(公告)日：2024-12-05

申请号：US18661336

申请日：2024-05-10

Applicant: Apple Inc.

Inventor： Alexander Menzies ,  Tobias Rick ,  Alexandre Da Veiga ,  Bryce L. Schmidtchen ,  Vedant Saran ,  Bryan Cline ,  Michael I. Weinstein ,  Tsao-Wei Huang

IPC: H04N13/20 ,  G06T5/50 ,  G06T11/60

Abstract: Embodiments disclosed herein are directed to devices, systems, and methods for separately processing an image stream to generate a first set of images for display by a set of displays and a second set of images for storage or transfer as part of a media capture event. Specifically, a first set of images from an image stream may be used to generate a first set of transformed images, and these transformed images may be displayed on a set of displays. A second set of images may be selected from the image stream in response to a capture request associated with a media capture event, and the second set of images may be used to generate a second set of transformed images. A set of output images may be generated from the second set of transformed images, and the set of output images may be stored or transmitted for later viewing.

公开(公告)号：US20230244308A1

公开(公告)日：2023-08-03

申请号：US18096090

申请日：2023-01-12

Applicant: Apple Inc.

Inventor： Gregory Lutter ,  Bryce L. Schmidtchen

IPC: G06F3/01 ,  G06F3/04842

CPC classification number: G06F3/013 ,  G06F3/04842

Abstract: In one implementation, a method is performed for selecting a UI element with eye tracking-based attention accumulators. The method includes: while a first UI element is currently selected, detecting a gaze direction directed to a second UI element; in response to detecting the gaze direction directed to the second UI element, decreasing a first attention accumulator value associated with the first UI element and increasing a second attention accumulator value associated with the second UI element; in accordance with a determination that the second attention accumulator value exceeds the first attention accumulator value, deselecting the first UI element and selecting the second UI element; and in accordance with a determination that the second attention accumulator value does not exceed the first attention accumulator value, maintaining selection of the first UI element.

公开(公告)号：US20240104872A1

公开(公告)日：2024-03-28

申请号：US18371243

申请日：2023-09-21

Applicant: Apple Inc.

Inventor： Bryce L. Schmidtchen ,  Bryan Cline ,  Charles O. Goddard ,  Michael I. Weinstein ,  Tsao-Wei Huang ,  Tobias Rick ,  Vedant Saran ,  Alexander Menzies ,  Alexandre Da Veiga

IPC: G06T19/20 ,  G06T5/00 ,  G06T15/04 ,  G06T15/10 ,  G06T19/00

CPC classification number: G06T19/20 ,  G06T5/002 ,  G06T15/04 ,  G06T15/10 ,  G06T19/006 ,  G06T2219/2004

Abstract: Various implementations provide a view of a 3D environment including a portal for viewing a stereo item (e.g., a photo or video) positioned a distance behind the portal. One or more visual effects are provided based on texture of one or more portions of the stereo item, e.g., texture at cutoff or visible edges of the stereo item. The effects change the appearance of the stereo item or the portal itself, e.g., improving visual comfort issues by minimizing window violations or otherwise enhancing the viewing experience. Various implementations provide a view of a 3D environment including an immersive view of a stereo item without using portal. Such a visual effect may be provided to partially obscure the surrounding 3D environment.

公开(公告)号：US20230394755A1

公开(公告)日：2023-12-07

申请号：US18204088

申请日：2023-05-31

Applicant: Apple Inc.

Inventor： Ioana Negoita ,  Alesha Unpingco ,  Bryce L. Schmidtchen ,  Devin W. Chalmers ,  Lee Sparks ,  Thomas J. Moore

IPC: G06T17/00 ,  G06T7/20 ,  G06V10/25 ,  G06V10/74 ,  G06F3/01 ,  G06F3/14 ,  G10L15/26

CPC classification number: G06T17/00 ,  G06T7/20 ,  G06V10/25 ,  G06V10/761 ,  G06F3/013 ,  G06F3/14 ,  G10L15/26 ,  G06T2207/20104

Abstract: A method includes presenting a representation of a three-dimensional (3D) environment from a current point-of-view. The method includes identifying a region of interest within the 3D environment. The region of interest is located at a first distance from the current point-of-view. The method includes receiving, via the audio sensor, an audible signal and converting the audible signal to audible signal data. The method includes displaying, on the display, a visual representation of the audible signal data at a second distance from the current point-of-view that is a function of the first distance between the region of interest and the current point-of-view.