公开(公告)号：US11012774B2

公开(公告)日：2021-05-18

申请号：US16575178

申请日：2019-09-18

Applicant: Apple Inc.

Inventor： Jonathan D. Sheaffer ,  Joshua D. Atkins ,  Peter A. Raffensperger ,  Symeon Delikaris Manias

IPC: H04R3/00 ,  G10L19/08 ,  H04R5/04 ,  H04S7/00 ,  H04R1/02 ,  G10L21/0216

Abstract: A method for producing a target directivity function that includes a set of spatially biased HRTFs. A set of left ear and right ear head related transfer functions (HRTFs) are selected. The left ear and right ear head HRTFs are multiplied with an on-camera emphasis function (OCE), to produce the spatially biased HRTFs. The OCE may be designed to shape the sound profile of the HRTFs to provide emphasis in a desired location or direction that is a function of the specific orientation of the device as it is being used to make a video recording. Other aspects are also described and claimed.

公开(公告)号：US12141347B1

公开(公告)日：2024-11-12

申请号：US18055600

申请日：2022-11-15

Applicant: Apple Inc.

Inventor： Mehrez Souden ,  Symeon Delikaris Manias ,  Ante Jukic ,  John Woodruff ,  Joshua D. Atkins

IPC: G06F3/01 ,  G10L15/16 ,  G10L15/24

Abstract: An audio processing device may generate a plurality of microphone signals from a plurality of microphones of the audio processing device. The audio processing device may determine a gaze of a user who is wearing a playback device that is separate from the audio processing device, the gaze of the user being determined relative to the audio processing device. The audio processing device may extract speech that correlates to the gaze of the user, from the plurality of microphone signals of the audio processing device by applying the plurality of microphone signals of the audio processing device and the gaze of the user to a machine learning model. The extracted speech may be played to the user through the playback device.

公开(公告)号：US12010490B1

公开(公告)日：2024-06-11

申请号：US18149659

申请日：2023-01-03

Applicant: Apple Inc.

Inventor： Symeon Delikaris Manias ,  Mehrez Souden ,  Ante Jukic ,  Matthew S. Connolly ,  Sabine Webel ,  Ronald J. Guglielmone, Jr.

IPC: H04R3/00 ,  H04R5/04

CPC classification number: H04R3/005 ,  H04R5/04

Abstract: An audio renderer can have a machine learning model that jointly processes audio and visual information of an audiovisual recording. The audio renderer can generate output audio channels. Sounds captured in the audiovisual recording and present in the output audio channels are spatially mapped based on the joint processing of the audio and visual information by the machine learning model. Other aspects are described.

公开(公告)号：US20240098444A1

公开(公告)日：2024-03-21

申请号：US18454508

申请日：2023-08-23

Applicant: Apple Inc.

Inventor： Sina Zamani ,  Moo Young Kim ,  Dipanjan Sen ,  Sang Uk Ryu ,  Juha O. Merimaa ,  Symeon Delikaris Manias

IPC: H04S7/00

CPC classification number: H04S7/303 ,  H04S2420/11

Abstract: In one aspect, a computer-implemented method, includes obtaining object audio and metadata that spatially describes the object audio, converting the object audio to Ambisonics audio based on the metadata, encoding, in a first bit stream, the Ambisonics audio, and encoding, in a second bit stream, at least a subset of the metadata.

公开(公告)号：US20240007816A1

公开(公告)日：2024-01-04

申请号：US18212488

申请日：2023-06-21

Applicant: Apple Inc.

Inventor： Shai Messingher Lang ,  Jonathan D. Sheaffer ,  Symeon Delikaris Manias

IPC: H04S7/00

CPC classification number: H04S7/302

Abstract: In one implementation, a method of visualizing a combined audio pick-up pattern is performed at a first device in a physical environment, the first device including a display, one or more processors, and non-transitory memory. The method includes determining a first audio pick-up pattern of the first device. The method includes determining one or more second audio pick-up patterns of a respective one or more second devices. The method includes determining a combined audio pick-up pattern of the first device and the one or more second devices based on the first audio pick-up pattern and the one or more second audio pick-up patterns. The method includes displaying, on the display, a representation of the combined audio pick-up pattern.
In one implementation, a method of determining an audio emission pattern is performed at a first device at a first location, the first device having a microphone, one or more processors, and non-transitory memory. The method includes obtaining, via the microphone, first audio of a sound source. The method includes receiving, from one or more second devices, one or more second audio of the sound source. The method includes determining one or more second locations of the one or more second devices. The method includes determining an audio emission pattern of the sound source based on the first audio data, the one or more second audio data, and the one or more second locations, wherein the audio emission pattern of the sound source indicates a sound level at various locations relative to the sound source.

公开(公告)号：US20230396921A1

公开(公告)日：2023-12-07

申请号：US18200262

申请日：2023-05-22

Applicant: APPLE INC.

Inventor： Abhaya Parthy ,  Dipanjan Sen ,  Bonnie W. Tom ,  Jonathan D. Sheaffer ,  Justin D. Crosby ,  Symeon Delikaris Manias ,  Emily A. Wigley

IPC: H04R3/00

CPC classification number: H04R3/005 ,  H04R31/00

Abstract: A multi-radius spherical microphone that includes an inner body defining an inner sphere having an inner radius from a center; a plurality of inner microphones coupled to the inner spherical body and defining an array of inner microphones; an outer body defining an dodecahedron, wherein the inner body and the outer body are concentric about the center; and a plurality of outer microphones coupled to the outer body at respective vertices of the dodecahedron and defining an array of outer microphones, wherein each of the plurality of outer microphones is positioned radially equidistant from the center.

公开(公告)号：US11832082B2

公开(公告)日：2023-11-28

申请号：US17514881

申请日：2021-10-29

Applicant: Apple Inc.

Inventor： Jonathan D. Sheaffer ,  Daniel K. Boothe ,  Martin E. Johnson ,  Neal D. Evans ,  Nikolas T. Vitt ,  Christopher T. Eubank ,  Peter V. Jupin ,  Symeon Delikaris Manias ,  Shai Messingher Lang

IPC: H04S7/00 ,  H04R1/10 ,  H04R1/40 ,  H04R29/00

CPC classification number: H04S7/301 ,  H04R1/1008 ,  H04R1/403 ,  H04R1/406 ,  H04R29/005 ,  H04S2400/01 ,  H04S2420/01

Abstract: A method for self-calibrating a sound pickup process that uses a microphone array in a wearable device that also includes a loudspeaker, where the microphone array being in a physical arrangement with respect to the loudspeaker. The method obtains, for each of several microphones of the microphone array, one or more transfer functions that each represent a response of the microphone to sound from a position in an acoustic space. The method determines whether a physical arrangement of the microphone array with respect to the loudspeaker has changed and adjusts the transfer function, for at least one of the microphones of the several microphones, in response to determining that the current physical arrangement of the microphone array with respect to the loudspeaker has changed.

公开(公告)号：US20230344973A1

公开(公告)日：2023-10-26

申请号：US18215371

申请日：2023-06-28

Applicant: Apple Inc.

Inventor： Shai Messingher Lang ,  Alexandre Da Veiga ,  Spencer H. Ray ,  Symeon Delikaris Manias

IPC: G11B27/10 ,  G10L25/51 ,  H04N9/802 ,  H04S7/00

CPC classification number: H04N9/802 ,  G10L25/51 ,  G11B27/10 ,  H04S7/302

Abstract: Various implementations disclosed herein include devices, systems, and methods that that modify audio of played back AV content based on context in accordance with some implementations. In some implementations audio-visual content of a physical environment is obtained, and the audio-visual content includes visual content and audio content that includes a plurality of audio portions corresponding to the visual content. In some implementations, a context for presenting the audio-visual content is determined, and a temporal relationship between one or more audio portions of the plurality of audio portions and the visual content is determined based on the context. Then, synthesized audio-visual content is presented based on the temporal relationship.

公开(公告)号：US11678111B1

公开(公告)日：2023-06-13

申请号：US17348336

申请日：2021-06-15

Applicant: Apple Inc.

Inventor： Shai Messingher Lang ,  Symeon Delikaris Manias

IPC: H04R1/40 ,  G10L25/30 ,  G06F3/01 ,  H04R3/00 ,  G06N3/08

CPC classification number: H04R1/406 ,  G06F3/012 ,  G06N3/08 ,  G10L25/30 ,  H04R3/005

Abstract: A machine learning model can determine output frequency response at different directions relative to a target audio output format, based on input including frequency response at directions relative to microphones of a capture device. A spatial filter determined based on the output frequency responses is applied to one or more of the microphone signals to map the spatial information from the microphone signals to the target audio output.

公开(公告)号：US20250106579A1

公开(公告)日：2025-03-27

申请号：US18476280

申请日：2023-09-27

Applicant: Apple Inc.

Inventor： Symeon Delikaris Manias

IPC: H04S7/00 ,  H04R5/04

Abstract: A method that includes receiving a higher-order ambisonics (HOA) representation of a sound field that includes a first plurality of audio signals, separating a second plurality of audio signals from the first plurality of audio signals that are associated with a first-order ambisonics (FOA) representation of the sound field, determining a plurality of adaptive filters based on at least some of the second plurality of audio signals, producing a plurality of output audio signals based on the first plurality of audio signals and the plurality of adaptive filters, each output audio signal having at least a portion of the sound field, and driving a plurality of speakers using the plurality of output audio signals.