公开(公告)号：US20240104872A1

公开(公告)日：2024-03-28

申请号：US18371243

申请日：2023-09-21

Applicant: Apple Inc.

Inventor： Bryce L. Schmidtchen ,  Bryan Cline ,  Charles O. Goddard ,  Michael I. Weinstein ,  Tsao-Wei Huang ,  Tobias Rick ,  Vedant Saran ,  Alexander Menzies ,  Alexandre Da Veiga

IPC: G06T19/20 ,  G06T5/00 ,  G06T15/04 ,  G06T15/10 ,  G06T19/00

CPC classification number: G06T19/20 ,  G06T5/002 ,  G06T15/04 ,  G06T15/10 ,  G06T19/006 ,  G06T2219/2004

Abstract: Various implementations provide a view of a 3D environment including a portal for viewing a stereo item (e.g., a photo or video) positioned a distance behind the portal. One or more visual effects are provided based on texture of one or more portions of the stereo item, e.g., texture at cutoff or visible edges of the stereo item. The effects change the appearance of the stereo item or the portal itself, e.g., improving visual comfort issues by minimizing window violations or otherwise enhancing the viewing experience. Various implementations provide a view of a 3D environment including an immersive view of a stereo item without using portal. Such a visual effect may be provided to partially obscure the surrounding 3D environment.

公开(公告)号：US20240040099A1

公开(公告)日：2024-02-01

申请号：US18377101

申请日：2023-10-05

Applicant: Apple Inc.

Inventor： Alexandre Da Veiga ,  Timothy T. Chong

IPC: H04N13/128 ,  G06T7/593 ,  H04N13/383 ,  G06F3/01

CPC classification number: H04N13/128 ,  G06T7/593 ,  H04N13/383 ,  G06F3/013 ,  H04N2013/0081

Abstract: Various implementations disclosed herein include devices, systems, and methods that modify a video to enable replay of the video with a depth-based effect based on gaze of a user during capture or playback of the video. For example, an example process may include tracking a gaze direction during a capture or a playback of a video, wherein the video includes a sequence of frames including depictions of a three-dimensional (3D) environment, identifying a portion of the 3D environment depicted in the video based on the gaze direction, determining a depth of the identified portion of the 3D environment, and modifying the video to enable replay of the video with a depth-based effect based on the depth of the identified portion.

公开(公告)号：US20230419593A1

公开(公告)日：2023-12-28

申请号：US18244355

申请日：2023-09-11

Applicant: Apple Inc.

Inventor： Alexandre Da Veiga ,  Tobias Rick ,  Timothy R. Pease

IPC: G06T15/20 ,  G06T7/593 ,  G06F3/01 ,  G06T19/00

CPC classification number: G06T15/20 ,  G06T7/593 ,  G06F3/013 ,  G06T19/006 ,  G06T2200/24

Abstract: Various implementations disclosed herein include devices, systems, and methods that present views of media objects using different viewing states determined based on context. In some implementations, a view of a 3D environment is presented. Then, a context associated with viewing one or more media objects within the 3D environment is determined, the media objects associated with data for providing an appearance of depth within the one or more media objects. Based on the context, a viewing state is determined for viewing a media object of the one or more media objects within the 3D environment, the viewing state defining whether the media object will be presented as a planar object or with depth within the media object. In accordance with a determination that the viewing state is a first viewing state, the media object is presented within the 3D environment using its associated data for providing the appearance of depth.

公开(公告)号：US20230262406A1

公开(公告)日：2023-08-17

申请号：US18079669

申请日：2022-12-12

Applicant: APPLE INC.

Inventor： Shai Messingher Lang ,  Alexandre Da Veiga ,  Spencer H. Ray ,  Symeon Delikaris Manias

IPC: H04S7/00 ,  H04S3/00 ,  G06F3/01

CPC classification number: H04S7/303 ,  H04S3/008 ,  G06F3/011 ,  H04S2400/11 ,  H04S2400/01

Abstract: Various implementations disclosed herein include devices, systems, and methods that display visual content as part of a 3D environment and add audio corresponding to the visual content. The audio may be spatialized to be from one or more audio source locations within the 3D environment. For example, a video may be presented on a virtual surface within an extended reality (XR) environment while audio associated with the video is spatialized to sound as if it is produced from an audio source location corresponding to that virtual surface. How the audio is provided may be determined based on the position of the viewer (e.g., the user or his/her device) relative to the presented visual content.

公开(公告)号：US20190340799A1

公开(公告)日：2019-11-07

申请号：US16138779

申请日：2018-09-21

Applicant: Apple Inc.

Inventor： Allison W. Dryer ,  Grant R. Paul ,  Jonathan R. Dascola ,  Lisa K. Forssell ,  Andrew H. Goulding ,  Stephen O. Lemay ,  Giancarlo Yerkes ,  Jeffrey S. Norris ,  Alexandre Da Veiga

IPC: G06T11/60 ,  H04N5/232 ,  G06F3/0488 ,  G06F3/01

Abstract: An electronic device displays a field of view of a camera with a view of a three-dimensional space and updates the field of view based on changes detected by the camera. While a measurement-point-creation indicator is over a determined anchor point in the field of view, the device changes a visual appearance of the indicator to indicate that a measurement point will be added at the anchor point if a touch input meets first criteria. In response to a touch input that meets the first criteria, a measurement point is added at the anchor point if the indicator is over the anchor point, and at a location away from the anchor point if not. In response to movement of the camera changing the field of view, if the field of view does not include a feature to which measurement points can be added, the measurement-point-creation indicator ceases to be displayed.

公开(公告)号：US12051170B2

公开(公告)日：2024-07-30

申请号：US18371243

申请日：2023-09-21

Applicant: Apple Inc.

Inventor： Bryce L. Schmidtchen ,  Bryan Cline ,  Charles O. Goddard ,  Michael I. Weinstein ,  Tsao-Wei Huang ,  Tobias Rick ,  Vedant Saran ,  Alexander Menzies ,  Alexandre Da Veiga

IPC: G06T19/20 ,  G06T5/70 ,  G06T15/04 ,  G06T15/10 ,  G06T19/00

CPC classification number: G06T19/20 ,  G06T5/70 ,  G06T15/04 ,  G06T15/10 ,  G06T19/006 ,  G06T2219/2004

Abstract: Various implementations provide a view of a 3D environment including a portal for viewing a stereo item (e.g., a photo or video) positioned a distance behind the portal. One or more visual effects are provided based on texture of one or more portions of the stereo item, e.g., texture at cutoff or visible edges of the stereo item. The effects change the appearance of the stereo item or the portal itself, e.g., improving visual comfort issues by minimizing window violations or otherwise enhancing the viewing experience. Various implementations provide a view of a 3D environment including an immersive view of a stereo item without using portal. Such a visual effect may be provided to partially obscure the surrounding 3D environment.

公开(公告)号：US20240007607A1

公开(公告)日：2024-01-04

申请号：US18367660

申请日：2023-09-13

Applicant: Apple Inc.

Inventor： Alexandre Da Veiga ,  Alexander Menzies ,  Tobias Rick

IPC: H04N13/275 ,  G06T17/00 ,  H04N13/344 ,  H04N13/351 ,  H04N13/383

CPC classification number: H04N13/275 ,  G06T17/00 ,  H04N13/344 ,  H04N13/351 ,  H04N13/383 ,  H04N2013/0081

Abstract: Various implementations disclosed herein include devices, systems, and methods that determine and provide a transition (optionally including a transition effect) between different types of views of three-dimensional (3D) content. For example, an example process may include obtaining a 3D content item, providing a first view of the 3D content item within a 3D environment, determining to transition from the first view to a second view of the 3D content item based on a criterion, and providing the second view of the 3D content item within the 3D environment, where the left eye view and the right eye view of the 3D content item are based on at least one of the left eye content and the right eye content.

公开(公告)号：US20230419625A1

公开(公告)日：2023-12-28

申请号：US18367490

申请日：2023-09-13

Applicant: Apple Inc.

Inventor： Shih-Sang Chiu ,  Alexandre Da Veiga ,  David H. Huang ,  Jonathan Perron ,  Jordan A. Cazamias

IPC: G06T19/00 ,  G06V10/20 ,  G06V10/22

CPC classification number: G06T19/006 ,  G06V10/255 ,  G06V10/235

Abstract: Various implementations provide a representation of at least a portion of a user within a three-dimensional (3D) environment other than the user's physical environment. Based on detecting a condition, a representation of another object of the user's physical environment is shown to provide context. As examples, a representation of a sitting surface may be shown based on detecting that the user is sitting down, representations of a table and coffee cup may be shown based on detecting that the user is reaching out to pick up a coffee cup, a representation of a second user may be shown based on detecting a voice or the user turning his attention towards a moving object or sound, and a depiction of a puppy may be shown when the puppy's bark is detected.

公开(公告)号：US11830214B2

公开(公告)日：2023-11-28

申请号：US16424937

申请日：2019-05-29

Applicant: Apple Inc.

Inventor： Jeffrey S. Norris ,  Alexandre Da Veiga ,  Bruno M. Sommer ,  Ye Cong ,  Tobias Eble ,  Moinul Khan ,  Nicolas Bonnier ,  Hao Pan

IPC: G06V10/44 ,  G06V20/20 ,  G06K9/00 ,  G06T7/73 ,  G02B27/01 ,  G06V10/46 ,  G06V10/24

CPC classification number: G06T7/73 ,  G02B27/017 ,  G06V10/245 ,  G06V10/462 ,  G06V20/20 ,  G06T2207/30204

Abstract: A method includes obtaining first pass-through image data characterized by a first pose. The method includes obtaining respective pixel characterization vectors for pixels in the first pass-through image data. The method includes identifying a feature of an object within the first pass-through image data in accordance with a determination that pixel characterization vectors for the feature satisfy a feature confidence threshold. The method includes displaying the first pass-through image data and an AR display marker that corresponds to the feature. The method includes obtaining second pass-through image data characterized by a second pose. The method includes transforming the AR display marker to a position associated with the second pose in order to track the feature. The method includes displaying the second pass-through image data and maintaining display of the AR display marker that corresponds to the feature of the object based on the transformation.

公开(公告)号：US11763477B2

公开(公告)日：2023-09-19

申请号：US17182344

申请日：2021-02-23

Applicant: Apple Inc.

Inventor： Alexandre Da Veiga ,  George J. Hito ,  Timothy R. Pease

IPC: G06T7/60 ,  G06T7/73

CPC classification number: G06T7/60 ,  G06T7/73 ,  G06T2207/10028 ,  G06T2207/30201

Abstract: Various implementations disclosed herein include devices, systems, and methods that determines a distance between a portion (e.g., top) of a person's head and the floor below as an estimate of the person's height. For example, an example process may include determining a first position on a head of a person in a three-dimensional (3D) coordinate system, the first position determined based on detecting a feature on the head based on a two-dimensional (2D) image of the person in a physical environment, determining a second position on a floor below the first position in the 3D coordinate system, and estimating a height based on determining a distance between the first position and the second position.