-
公开(公告)号:US20240098442A1
公开(公告)日:2024-03-21
申请号:US18458077
申请日:2023-08-29
Applicant: Apple Inc.
Inventor: Shai Messingher Lang , Joshua D. Atkins , Scott A. Wardle , Symeon Delikaris Manias
IPC: H04S7/00
CPC classification number: H04S7/302 , H04S2400/11
Abstract: An audio processing system may obtain a size of a visual object to present to a display. The audio processing system may determine a virtual placement for each of a plurality of virtual speakers at least based on the size of the visual object. Each of the plurality of virtual speakers may be spatially rendered at each virtual placement through binaural audio, for playback through head-worn speakers. Other aspects are also described and claimed.
-
公开(公告)号:US11758348B1
公开(公告)日:2023-09-12
申请号:US17570251
申请日:2022-01-06
Applicant: Apple Inc.
Inventor: Jared King , Shai Messingher Lang , Symeon Delikaris Manias
CPC classification number: H04S7/303 , H04S5/00 , H04S2420/11
Abstract: Each of a plurality of virtual loudspeaker arrays and their channels are produced, based on a corresponding microphone array and microphone signals thereof. Channels of a hallucinated loudspeaker array are determined based on the channels of the plurality of virtual loudspeaker arrays. The plurality of virtual loudspeaker arrays and the hallucinated loudspeaker array share a common geometry and orientation. Spatial audio is rendered based on the channels of the hallucinated loudspeaker array.
-
公开(公告)号:US20230262406A1
公开(公告)日:2023-08-17
申请号:US18079669
申请日:2022-12-12
Applicant: APPLE INC.
Inventor: Shai Messingher Lang , Alexandre Da Veiga , Spencer H. Ray , Symeon Delikaris Manias
CPC classification number: H04S7/303 , H04S3/008 , G06F3/011 , H04S2400/11 , H04S2400/01
Abstract: Various implementations disclosed herein include devices, systems, and methods that display visual content as part of a 3D environment and add audio corresponding to the visual content. The audio may be spatialized to be from one or more audio source locations within the 3D environment. For example, a video may be presented on a virtual surface within an extended reality (XR) environment while audio associated with the video is spatialized to sound as if it is produced from an audio source location corresponding to that virtual surface. How the audio is provided may be determined based on the position of the viewer (e.g., the user or his/her device) relative to the presented visual content.
-
公开(公告)号:US20240073638A1
公开(公告)日:2024-02-29
申请号:US18497933
申请日:2023-10-30
Applicant: Apple Inc.
Inventor: Jonathan D. Sheaffer , Daniel K. Boothe , Martin E. Johnson , Neal D. Evans , Nikolas T. Vitt , Christopher T. Eubank , Peter V. Jupin , Symeon Delikaris Manias , Shai Messingher Lang
CPC classification number: H04S7/301 , H04R1/1008 , H04R1/403 , H04R1/406 , H04R29/005 , H04S2400/01 , H04S2420/01
Abstract: A method for self-calibrating a sound pickup process that uses a microphone array in a wearable device that also includes a loudspeaker, where the microphone array being in a physical arrangement with respect to the loudspeaker. The method obtains, for each of several microphones of the microphone array, one or more transfer functions that each represent a response of the microphone to sound from a position in an acoustic space. The method determines whether a physical arrangement of the microphone array with respect to the loudspeaker has changed and adjusts the transfer function, for at least one of the microphones of the several microphones, in response to determining that the current physical arrangement of the microphone array with respect to the loudspeaker has changed.
-
公开(公告)号:US11729363B2
公开(公告)日:2023-08-15
申请号:US17826546
申请日:2022-05-27
Applicant: Apple Inc.
Inventor: Shai Messingher Lang , Alexandre Da Veiga , Spencer H. Ray , Symeon Delikaris Manias
IPC: H04N9/802 , G11B27/10 , G10L25/51 , H04S7/00 , H04N21/4722
Abstract: Various implementations disclosed herein include devices, systems, and methods that that modify audio of played back AV content based on context in accordance with some implementations. In some implementations audio-visual content of a physical environment is obtained, and the audio-visual content includes visual content and audio content that includes a plurality of audio portions corresponding to the visual content. In some implementations, a context for presenting the audio-visual content is determined, and a temporal relationship between one or more audio portions of the plurality of audio portions and the visual content is determined based on the context. Then, synthesized audio-visual content is presented based on the temporal relationship.
-
公开(公告)号:US11546687B1
公开(公告)日:2023-01-03
申请号:US17392069
申请日:2021-08-02
Applicant: Apple Inc.
Inventor: Symeon Delikaris Manias , Shai Messingher Lang , Juha O. Merimaa
IPC: H04R1/32
Abstract: Spatial filters are generated that map response of an audio capture device to head related transfer functions (HRTFs) for different positions of the audio capture device relative to the HRTFs. A current set of spatial filters are determined based on the plurality of spatial filters and a head position of a user. The microphone signals are convolved with the current set of spatial filters, resulting in a left audio channel and right audio channel that form output binaural audio channels. The binaural audio channels can be used to drive speakers of a headphone set to generate sound that is perceived to have a spatial quality. Other aspects are described and claimed.
-
公开(公告)号:US20220368875A1
公开(公告)日:2022-11-17
申请号:US17826546
申请日:2022-05-27
Applicant: Apple Inc.
Inventor: Shai Messingher Lang , Alexandre Da Veiga , Spencer H. Ray , Symeon Delikaris Manias
Abstract: Various implementations disclosed herein include devices, systems, and methods that that modify audio of played back AV content based on context in accordance with some implementations. In some implementations audio-visual content of a physical environment is obtained, and the audio-visual content includes visual content and audio content that includes a plurality of audio portions corresponding to the visual content. In some implementations, a context for presenting the audio-visual content is determined, and a temporal relationship between one or more audio portions of the plurality of audio portions and the visual content is determined based on the context. Then, synthesized audio-visual content is presented based on the temporal relationship.
-
公开(公告)号:US11381797B2
公开(公告)日:2022-07-05
申请号:US17358263
申请日:2021-06-25
Applicant: Apple Inc.
Inventor: Shai Messingher Lang , Alexandre Da Veiga , Spencer H. Ray , Symeon Delikaris Manias
Abstract: Various implementations disclosed herein include devices, systems, and methods that that modify audio of played back AV content based on context in accordance with some implementations. In some implementations audio-visual content of a physical environment is obtained, and the audio-visual content includes visual content and audio content that includes a plurality of audio portions corresponding to the visual content. In some implementations, a context for presenting the audio-visual content is determined, and a temporal relationship between one or more audio portions of the plurality of audio portions and the visual content is determined based on the context. Then, synthesized audio-visual content is presented based on the temporal relationship.
-
公开(公告)号:US20210321070A1
公开(公告)日:2021-10-14
申请号:US17358263
申请日:2021-06-25
Applicant: Apple Inc.
Inventor: Shai Messingher Lang , Alexandre Da Veiga , Spencer H. Ray , Symeon Delikaris Manias
Abstract: Various implementations disclosed herein include devices, systems, and methods that that modify audio of played back AV content based on context in accordance with some implementations. In some implementations audio-visual content of a physical environment is obtained, and the audio-visual content includes visual content and audio content that includes a plurality of audio portions corresponding to the visual content. In some implementations, a context for presenting the audio-visual content is determined, and a temporal relationship between one or more audio portions of the plurality of audio portions and the visual content is determined based on the context. Then, synthesized audio-visual content is presented based on the temporal relationship.
-
-
-
-
-
-
-
-