公开(公告)号：US20230351676A1

公开(公告)日：2023-11-02

申请号：US18219822

申请日：2023-07-10

Applicant: APPLE INC.

Inventor： David H. HUANG ,  Bart TRZYNADLOWSKI

IPC: G06T15/20 ,  G06F3/01 ,  G06F3/04815

CPC classification number: G06T15/20 ,  G06F3/013 ,  G06F3/04815 ,  G06F3/012 ,  G06T2200/24

Abstract: Various implementations disclosed herein include devices, systems, and methods that detects user interactions with a content object of a set of views of a three-dimensional (3D) environment and provides a different set of views with a different positional constraint. For example, an example process may include associating a content object with a region of a physical environment, providing a first set of views of the physical environment, wherein the content object is displayed using a first positional constraint when included in the first set of views, detecting an interaction associated with the region of the physical environment, and in accordance with detecting the interaction, providing a second set of views of the physical environment, wherein the content object is displayed using a second positional constraint when included in the second set of views, the second positional constraint different than the first positional constraint.

公开(公告)号：US20250111605A1

公开(公告)日：2025-04-03

申请号：US18891984

申请日：2024-09-20

Applicant: Apple Inc.

Inventor： David H. HUANG ,  Randal W. LAMORE ,  Soravis PRAKKAMAKUL ,  Jason ROSSON ,  Jue WANG ,  Eric J. GEUSZ ,  Eric G. THIVIERGE

IPC: G06T17/00 ,  G06F3/01 ,  G06V20/70

Abstract: Some examples of the disclosure are directed to systems and methods for displaying an editing a virtual scene. In some examples, an electronic device can display an immersive virtual scene. In some examples, the immersive virtual scene is shared in a communication session with other electronic devices. In some examples, the electronic device can detect user input requesting insertion and display of an annotation into the virtual scene. In some examples, the electronic device can determine user context to determine placement and content associated with the inserted annotation, and display a representation of the annotation. In some examples, the electronic device can capture a virtual screenshot of the virtual scene. In some examples, the electronic device can display a user interface providing an overview of the annotations associated with the virtual scene.

公开(公告)号：US20250104335A1

公开(公告)日：2025-03-27

申请号：US18892227

申请日：2024-09-20

Applicant: Apple Inc.

Inventor： David H. HUANG ,  Randal W. LAMORE ,  Soravis PRAKKAMAKUL ,  Valentin F. ROUSSELLET ,  Arun Rakesh YOGANANDAN ,  Anette L. FREIIN VON KAPRI ,  Carmine ELVEZIO ,  Eric G. THIVIERGE ,  Zachary Z. BECKER ,  Jue WANG

IPC: G06T15/20 ,  G06T15/08 ,  G06T19/20

Abstract: Some examples of the disclosure are directed to systems and methods for displaying three-dimensional models of virtual three-dimensional environments. In some examples, the three-dimensional model includes representations of the virtual object(s) included in the environment, a representation of a viewpoint of a user of the electronic device in the environment, and a representation of a viewpoint of a second user of a different electronic device in the environment. In some examples, in response to receiving an input requesting to display the virtual three-dimensional environment (e.g., at full size), the electronic device displays the virtual three-dimensional environment from the viewpoint of the user of the electronic device indicated in the model.

公开(公告)号：US20240004536A1

公开(公告)日：2024-01-04

申请号：US18335978

申请日：2023-06-15

Applicant: Apple Inc.

Inventor： Samuel M. WEINIG ,  Lucie BELANGER ,  Angel Suet Yan CHEUNG ,  David H. HUANG ,  Dean JACKSON

IPC: G06F3/04845 ,  G06F3/04815

CPC classification number: G06F3/04845 ,  G06F3/04815

Abstract: Methods for preventing three-dimensional content from obscuring portions of a web browser or other user interface in a three-dimensional environment. In some embodiments, the methods include applying one or more visual treatments to the three-dimensional content. In some embodiments, the methods further include applying one or more visual treatments to portions of the web browser or portions of the other user interface. In some embodiments, the one or more visual treatments are applied at least from a viewpoint of a user. In some embodiments, applying the or more visual treatments is based on a three-dimensional visual effect of the three-dimensional content.

公开(公告)号：US20250104367A1

公开(公告)日：2025-03-27

申请号：US18892242

申请日：2024-09-20

Applicant: Apple Inc.

Inventor： David H. HUANG ,  Randal W. LAMORE ,  Soravis PRAKKAMAKUL ,  Valentin F. ROUSSELLET

IPC: G06T19/00

Abstract: Some examples of the disclosure are directed to systems and methods for displaying three-dimensional models of virtual three-dimensional environments. In some examples, the three-dimensional model includes representations of the virtual object(s) included in the environment, a representation of a viewpoint of a user of the electronic device in the environment, and a representation of a viewpoint of a second user of a different electronic device in the environment. In some examples, in response to receiving an input requesting to display the virtual three-dimensional environment (e.g., at full size), the electronic device displays the virtual three-dimensional environment from the viewpoint of the user of the electronic device indicated in the model.

公开(公告)号：US20230384907A1

公开(公告)日：2023-11-30

申请号：US18298994

申请日：2023-04-11

Applicant: Apple Inc.

Inventor： Benjamin H. BOESEL ,  Jonathan RAVASZ ,  Shih-Sang CHIU ,  Jordan A. CAZAMIAS ,  Stephen O. LEMAY ,  Christopher D. MCKENZIE ,  Dorian D. DARGAN ,  David H. HUANG

IPC: G06F3/04815 ,  G06F3/01 ,  G06F3/04845

CPC classification number: G06F3/04815 ,  G06F3/013 ,  G06F3/04845

Abstract: In some embodiments, a computer system facilitates manipulation of a three-dimensional environment relative to a viewpoint of a user of the computer system. In some embodiments, a computer system facilitates manipulation of virtual objects in a virtual environment. In some embodiments, a computer system facilitates manipulation of a three-dimensional environment relative to a reference point determined based on attention of a user of the computer system.

公开(公告)号：US20250110605A1

公开(公告)日：2025-04-03

申请号：US18892109

申请日：2024-09-20

Applicant: Apple Inc.

Inventor： David H. HUANG ,  Randal W. LAMORE ,  Soravis PRAKKAMAKUL ,  Valentin F. ROUSSELLET

IPC: G06F3/04815

Abstract: Some examples of the disclosure are directed to systems and methods for displaying a boundary associated with a virtual scene. In some examples, a device displays a virtual scene concurrently with the boundary. In some examples, the device presents representations of the user's physical environment when a viewpoint of a user of the device satisfies one or more criteria associated with the boundary. In some examples, the device displays visual indications of individuals physically co-located with the user of the device.

公开(公告)号：US20240310971A1

公开(公告)日：2024-09-19

申请号：US18671936

申请日：2024-05-22

Applicant: Apple Inc.

Inventor： Ieyuki KAWASHIMA ,  Stephen O. LEMAY ,  William A. SORRENTINO, III ,  Jeffrey M. FAULKNER ,  Israel PASTRANA VICENTE ,  Gary Ian BUTCHER ,  Kristi E. BAUERLY ,  Shih-Sang CHIU ,  Benjamin Hunter BOESEL ,  David H. HUANG ,  Dorian D. DARGAN

IPC: G06F3/0481 ,  G06F3/01 ,  G06F3/0487

CPC classification number: G06F3/0481 ,  G06F3/017 ,  G06F3/0487

Abstract: In some embodiments, an electronic device emphasizes and/or deemphasizes user interfaces based on the gaze of a user. In some embodiments, an electronic device defines levels of immersion for different user interfaces independently of one another. In some embodiments, an electronic device resumes display of a user interface at a previously-displayed level of immersion after (e.g., temporarily) reducing the level of immersion associated with the user interface. In some embodiments, an electronic device allows objects, people, and/or portions of an environment to be visible through a user interface displayed by the electronic device. In some embodiments, an electronic device reduces the level of immersion associated with a user interface based on characteristics of the electronic device and/or physical environment of the electronic device.

公开(公告)号：US20230290047A1

公开(公告)日：2023-09-14

申请号：US18110916

申请日：2023-02-17

Applicant: APPLE INC.

Inventor： Benjamin H. BOESEL ,  Emilie KIM ,  David H. HUANG ,  Shih-Sang (Carnaven) CHIU

IPC: G06T15/40 ,  G06T19/00

CPC classification number: G06T15/40 ,  G06T19/006

Abstract: Various implementations disclosed herein include devices, systems, and methods that adjusts content during an immersive experience. For example, an example process may include presenting a representation of a physical environment using content from a sensor located in the physical environment, detecting an object in the physical environment using the sensor, presenting a video, wherein the presented video occludes a portion of the presented representation of the physical environment, presenting a representation of the detected object, and in accordance with determining that the detected object meets a set of criteria, adjusting a level of occlusion of the presented representation of the detected object by the presented video, where the representation of the detected object indicates at least an estimate of a position between the sensor and the detected object, and is at least partially occluded by the presented video.

公开(公告)号：US20230281933A1

公开(公告)日：2023-09-07

申请号：US17984282

申请日：2022-11-10

Applicant: APPLE INC.

Inventor： Timothy R. PEASE ,  Alexandre DA VEIGA ,  Benjamin H. BOESEL ,  David H. HUANG ,  Jonathan PERRON ,  Shih-Sang CHIU ,  Spencer H. RAY

IPC: G06T19/00 ,  G06T7/30 ,  G06T7/70

CPC classification number: G06T19/006 ,  G06T7/30 ,  G06T7/70 ,  G06T2207/10024 ,  G06T2207/10016 ,  G06T2200/04 ,  G06T2207/10028 ,  G06T2210/56 ,  G06T2207/20021

Abstract: Various implementations disclosed herein include devices, systems, and methods that create a 3D video that includes determining first adjustments (e.g., first transforms) to video frames (e.g., one or more RGB images and depth images per frame) to align content in a coordinate system to remove the effects of capturing camera motion. Various implementations disclosed herein include devices, systems, and methods that playback a 3D video and includes determining second adjustments (e.g., second transforms) to remove the effects of movement of a viewing electronic device relative to a viewing environment during playback of the 3D video. Some implementations distinguish static content and moving content of the video frames to playback only moving objects or facilitate concurrent playback of multiple spatially related 3D videos. The 3D video may include images, audio, or 3D video of a video-capture-device user.