公开(公告)号：US20230262406A1

公开(公告)日：2023-08-17

申请号：US18079669

申请日：2022-12-12

Applicant: APPLE INC.

Inventor： Shai Messingher Lang ,  Alexandre Da Veiga ,  Spencer H. Ray ,  Symeon Delikaris Manias

IPC: H04S7/00 ,  H04S3/00 ,  G06F3/01

CPC classification number: H04S7/303 ,  H04S3/008 ,  G06F3/011 ,  H04S2400/11 ,  H04S2400/01

Abstract: Various implementations disclosed herein include devices, systems, and methods that display visual content as part of a 3D environment and add audio corresponding to the visual content. The audio may be spatialized to be from one or more audio source locations within the 3D environment. For example, a video may be presented on a virtual surface within an extended reality (XR) environment while audio associated with the video is spatialized to sound as if it is produced from an audio source location corresponding to that virtual surface. How the audio is provided may be determined based on the position of the viewer (e.g., the user or his/her device) relative to the presented visual content.

公开(公告)号：US12254579B2

公开(公告)日：2025-03-18

申请号：US17984282

申请日：2022-11-10

Applicant: APPLE INC.

Inventor： Timothy R. Pease ,  Alexandre Da Veiga ,  Benjamin H. Boesel ,  David H. Huang ,  Jonathan Perron ,  Shih-Sang Chiu ,  Spencer H. Ray

IPC: G06T17/00 ,  G06T7/30 ,  G06T7/579 ,  G06T7/70 ,  G06T19/00

Abstract: Various implementations disclosed herein include devices, systems, and methods that create a 3D video that includes determining first adjustments (e.g., first transforms) to video frames (e.g., one or more RGB images and depth images per frame) to align content in a coordinate system to remove the effects of capturing camera motion. Various implementations disclosed herein include devices, systems, and methods that playback a 3D video and includes determining second adjustments (e.g., second transforms) to remove the effects of movement of a viewing electronic device relative to a viewing environment during playback of the 3D video. Some implementations distinguish static content and moving content of the video frames to playback only moving objects or facilitate concurrent playback of multiple spatially related 3D videos. The 3D video may include images, audio, or 3D video of a video-capture-device user.

公开(公告)号：US20230344973A1

公开(公告)日：2023-10-26

申请号：US18215371

申请日：2023-06-28

Applicant: Apple Inc.

Inventor： Shai Messingher Lang ,  Alexandre Da Veiga ,  Spencer H. Ray ,  Symeon Delikaris Manias

IPC: G11B27/10 ,  G10L25/51 ,  H04N9/802 ,  H04S7/00

CPC classification number: H04N9/802 ,  G10L25/51 ,  G11B27/10 ,  H04S7/302

Abstract: Various implementations disclosed herein include devices, systems, and methods that that modify audio of played back AV content based on context in accordance with some implementations. In some implementations audio-visual content of a physical environment is obtained, and the audio-visual content includes visual content and audio content that includes a plurality of audio portions corresponding to the visual content. In some implementations, a context for presenting the audio-visual content is determined, and a temporal relationship between one or more audio portions of the plurality of audio portions and the visual content is determined based on the context. Then, synthesized audio-visual content is presented based on the temporal relationship.

公开(公告)号：US11729363B2

公开(公告)日：2023-08-15

申请号：US17826546

申请日：2022-05-27

Applicant: Apple Inc.

Inventor： Shai Messingher Lang ,  Alexandre Da Veiga ,  Spencer H. Ray ,  Symeon Delikaris Manias

IPC: H04N9/802 ,  G11B27/10 ,  G10L25/51 ,  H04S7/00 ,  H04N21/4722

CPC classification number: H04N9/802 ,  G10L25/51 ,  G11B27/10 ,  H04S7/302

Abstract: Various implementations disclosed herein include devices, systems, and methods that that modify audio of played back AV content based on context in accordance with some implementations. In some implementations audio-visual content of a physical environment is obtained, and the audio-visual content includes visual content and audio content that includes a plurality of audio portions corresponding to the visual content. In some implementations, a context for presenting the audio-visual content is determined, and a temporal relationship between one or more audio portions of the plurality of audio portions and the visual content is determined based on the context. Then, synthesized audio-visual content is presented based on the temporal relationship.

公开(公告)号：US20220368875A1

公开(公告)日：2022-11-17

申请号：US17826546

申请日：2022-05-27

Applicant: Apple Inc.

Inventor： Shai Messingher Lang ,  Alexandre Da Veiga ,  Spencer H. Ray ,  Symeon Delikaris Manias

IPC: H04N9/802 ,  G11B27/10 ,  G10L25/51 ,  H04S7/00

Abstract: Various implementations disclosed herein include devices, systems, and methods that that modify audio of played back AV content based on context in accordance with some implementations. In some implementations audio-visual content of a physical environment is obtained, and the audio-visual content includes visual content and audio content that includes a plurality of audio portions corresponding to the visual content. In some implementations, a context for presenting the audio-visual content is determined, and a temporal relationship between one or more audio portions of the plurality of audio portions and the visual content is determined based on the context. Then, synthesized audio-visual content is presented based on the temporal relationship.

公开(公告)号：US11381797B2

公开(公告)日：2022-07-05

申请号：US17358263

申请日：2021-06-25

Applicant: Apple Inc.

Inventor： Shai Messingher Lang ,  Alexandre Da Veiga ,  Spencer H. Ray ,  Symeon Delikaris Manias

IPC: H04N5/77 ,  H04N9/802 ,  G11B27/10 ,  G10L25/51 ,  H04S7/00 ,  H04N5/932

Abstract: Various implementations disclosed herein include devices, systems, and methods that that modify audio of played back AV content based on context in accordance with some implementations. In some implementations audio-visual content of a physical environment is obtained, and the audio-visual content includes visual content and audio content that includes a plurality of audio portions corresponding to the visual content. In some implementations, a context for presenting the audio-visual content is determined, and a temporal relationship between one or more audio portions of the plurality of audio portions and the visual content is determined based on the context. Then, synthesized audio-visual content is presented based on the temporal relationship.

公开(公告)号：US20210321070A1

公开(公告)日：2021-10-14

申请号：US17358263

申请日：2021-06-25

Applicant: Apple Inc.

Inventor： Shai Messingher Lang ,  Alexandre Da Veiga ,  Spencer H. Ray ,  Symeon Delikaris Manias

IPC: H04N9/802 ,  H04S7/00 ,  G10L25/51 ,  G11B27/10

Abstract: Various implementations disclosed herein include devices, systems, and methods that that modify audio of played back AV content based on context in accordance with some implementations. In some implementations audio-visual content of a physical environment is obtained, and the audio-visual content includes visual content and audio content that includes a plurality of audio portions corresponding to the visual content. In some implementations, a context for presenting the audio-visual content is determined, and a temporal relationship between one or more audio portions of the plurality of audio portions and the visual content is determined based on the context. Then, synthesized audio-visual content is presented based on the temporal relationship.