公开(公告)号：US20240357308A1

公开(公告)日：2024-10-24

申请号：US18667947

申请日：2024-05-17

Applicant: Apple Inc.

Inventor： Antti J. Vanne ,  Darius A. Satongar ,  James W. Vandyke ,  Juha O. Merimaa ,  Martin E. Johnson ,  Tomi A. Huttunen

IPC: H04S7/00 ,  G06F3/01 ,  H04R5/033 ,  H04R5/04

CPC classification number: H04S7/304 ,  G06F3/012 ,  G06F3/017 ,  H04R5/033 ,  H04R5/04 ,  H04S2420/01

Abstract: A media system and a method of using the media system to reproduce spatial audio based on head-to-torso orientation, are described. The method includes determining a head-to-source orientation and a head-to-torso orientation based on head orientation data generated by a head tracking device. Determining the head-to-torso orientation includes determining torso movements based on movements of the head. The torso can be determined to move when the head movements meet a head movement condition, such as a predetermined angle of movement or pattern of movement. A binaural audio filter that is based on a head-related transfer function corresponding to both the head-to-source orientation and the head-to-torso orientation is applied to an audio input signal to generate an audio output signal. The audio output signal is played to accurately recreate spatial audio having sounds emitted to the user by a sound source. Other aspects are also described and claimed.

公开(公告)号：US20240314509A1

公开(公告)日：2024-09-19

申请号：US18605701

申请日：2024-03-14

Applicant: Apple Inc.

Inventor： Ismael H. Nawfal ,  Mehrez Souden ,  Juha O. Merimaa

IPC: H04S7/00 ,  H04S1/00

CPC classification number: H04S7/30 ,  H04S1/007 ,  H04S2420/11

Abstract: A sound scene is represented as first order Ambisonics (FOA) audio. A processor formats each signal of the FOA audio to a stream of audio frames, provides the formatted FOA audio to a machine learning model that reformats the formatted FOA audio in a target or desired higher order Ambisonics (HOA) format, and obtains output audio of the sound scene in the desired HOA format from the machine learning model. The output audio in the desired HOA format may then be rendered according to a playback audio format of choice. Other aspects are also described and claimed.

公开(公告)号：US12010506B2

公开(公告)日：2024-06-11

申请号：US17847095

申请日：2022-06-22

Applicant: Apple Inc.

Inventor： Antti J. Vanne ,  Darius A. Satongar ,  James W. Vandyke ,  Juha O. Merimaa ,  Martin E. Johnson ,  Tomi A. Huttunen

IPC: H04S7/00 ,  G06F3/01 ,  H04R5/033 ,  H04R5/04

CPC classification number: H04S7/304 ,  G06F3/012 ,  G06F3/017 ,  H04R5/033 ,  H04R5/04 ,  H04S2420/01

Abstract: A media system and a method of using the media system to reproduce spatial audio based on head-to-torso orientation, are described. The method includes determining a head-to-source orientation and a head-to-torso orientation based on head orientation data generated by a head tracking device. Determining the head-to-torso orientation includes determining torso movements based on movements of the head. The torso can be determined to move when the head movements meet a head movement condition, such as a predetermined angle of movement or pattern of movement. A binaural audio filter that is based on a head-related transfer function corresponding to both the head-to-source orientation and the head-to-torso orientation is applied to an audio input signal to generate an audio output signal. The audio output signal is played to accurately recreate spatial audio having sounds emitted to the user by a sound source. Other aspects are also described and claimed.

公开(公告)号：US20240096335A1

公开(公告)日：2024-03-21

申请号：US18454409

申请日：2023-08-23

Applicant: Apple Inc.

Inventor： Sina Zamani ,  Moo Young Kim ,  Dipanjan Sen ,  Sang Uk Ryu ,  Juha O. Merimaa ,  Symeon Delikaris Manias

IPC: G10L19/008 ,  G10L25/03

CPC classification number: G10L19/008 ,  G10L25/03

Abstract: In one aspect, a computer-implemented method, includes obtaining object audio and metadata that spatially describes the object audio, converting the object audio to time-frequency domain Ambisonics audio based on the metadata, and encoding the time-frequency domain Ambisonics audio and a subset of the metadata as one or more bitstreams to be stored in computer-readable memory or transmitted to a remote device.

公开(公告)号：US11841899B2

公开(公告)日：2023-12-12

申请号：US16899019

申请日：2020-06-11

Applicant: Apple Inc.

Inventor： Jonathan D. Sheaffer ,  Symeon Delikaris Manias ,  Gaetan R. Lorho ,  Peter A. Raffensperger ,  Eric A. Allamanche ,  Frank Baumgarte ,  Dipanjan Sen ,  Joshua D. Atkins ,  Juha O. Merimaa

IPC: G06F16/683 ,  G06F16/174 ,  H04R1/40 ,  H04R3/00

CPC classification number: G06F16/683 ,  G06F16/1744 ,  H04R1/406 ,  H04R3/005 ,  H04R2410/00

Abstract: A device with microphones can generate microphone signals during an audio recording. The device can store, in an electronic audio data file, the microphone signals, and metadata that includes impulse responses of the microphones. Other aspects are described and claimed.

公开(公告)号：US20160294343A1

公开(公告)日：2016-10-06

申请号：US15175970

申请日：2016-06-07

Applicant: Apple Inc.

Inventor： Arvindh Krishnaswamy ,  Juha O. Merimaa ,  Kapil Krishnamurthy ,  Yuchao Song

IPC: H03G3/30

CPC classification number: H03G3/3005 ,  H03G3/20 ,  H03G3/3089

Abstract: Automatic gain control systems disclosed herein can incorporate a confidence metric that can estimate the accuracy of gain adjustments calculated by an automatic gain control module. The confidence metric may be based on a percentage of valid audio samples in a given period of time. Based on the confidence metric, the AGC response may be reduced, delayed, frozen, or otherwise altered from the baseline gain adjustment. Time-averaging process may be used to estimate the input signal power level and determine an appropriate baseline gain adjustment. Additionally, weighting functions can be adjusted to prevent overestimation of the signal power.

公开(公告)号：US20160219386A1

公开(公告)日：2016-07-28

申请号：US15019521

申请日：2016-02-09

Applicant: Apple Inc.

Inventor： Arvindh Krishnaswamy ,  David T. Yeh ,  Juha O. Merimaa ,  Sean A. Ramprashad

IPC: H04R29/00 ,  H04R3/00

CPC classification number: H04R29/005 ,  H04R3/00 ,  H04R29/004 ,  H04R2499/11

Abstract: Systems and methods for determining the operating condition of multiple microphones of an electronic device are disclosed. A system can include a plurality of microphones operative to receive signals, a microphone condition detector, and a plurality of microphone condition determination sources. The microphone condition detector can determine a condition for each of the plurality of microphones by using the received signals and accessing at least one microphone condition determination source.

公开(公告)号：US11937063B2

公开(公告)日：2024-03-19

申请号：US17737897

申请日：2022-05-05

Applicant: Apple Inc.

Inventor： Juha O. Merimaa ,  Abdullah Fahim ,  Andrey D. Del Pozo ,  Joshua D. Atkins

IPC: H04R5/02 ,  H04S1/00 ,  H04S7/00 ,  H03G3/00

CPC classification number: H04S1/007 ,  H04S7/303 ,  H04S7/305 ,  H04S2420/01

Abstract: A method performed by a programmed processor of an audio system, the method includes receiving a sound track that has a track length, producing a binaural audio version of a sound track, the binaural audio version having an extended track length performing a fading operation upon the binaural audio version to gradually reduce a signal level of the binaural audio version to below a signal threshold level at a time along the extended track length that corresponds to an end time of the track length of the sound track; and storing the binaural audio version having the track length of the sound track in memory for later transmission to an audio playback device for driving one or more speakers.

公开(公告)号：US11805382B2

公开(公告)日：2023-10-31

申请号：US17673721

申请日：2022-02-16

Applicant: Apple Inc.

Inventor： Darius A. Satongar ,  Afrooz Family ,  Sylvain J. Choisel ,  Juha O. Merimaa

IPC: H04S7/00 ,  G06F3/01 ,  H04R5/033 ,  H04R5/04

CPC classification number: H04S7/304 ,  G06F3/012 ,  H04R5/033 ,  H04R5/04 ,  H04R2420/07 ,  H04R2460/07 ,  H04S2400/01 ,  H04S2400/11 ,  H04S2420/01

Abstract: A binaural sound reproduction system, and methods of using the binaural sound reproduction system to dynamically re-center a frame of reference for a virtual sound source, are described. The binaural sound reproduction system may include a reference device, e.g., a mobile device, having a reference sensor to provide reference orientation data corresponding to a direction of the reference device, and a head-mounted device, e.g., headphones, having a device sensor to provide device orientation data corresponding to a direction of the head-mounted device. The system may use the reference orientation data to determine whether the head-mounted device is being used in a static or dynamic use case, and may adjust an audio output to render the virtual sound source in an adjusted source direction based on the determined use case. Other embodiments are also described and claimed.

公开(公告)号：US11546687B1

公开(公告)日：2023-01-03

申请号：US17392069

申请日：2021-08-02

Applicant: Apple Inc.

Inventor： Symeon Delikaris Manias ,  Shai Messingher Lang ,  Juha O. Merimaa

IPC: H04R1/32

Abstract: Spatial filters are generated that map response of an audio capture device to head related transfer functions (HRTFs) for different positions of the audio capture device relative to the HRTFs. A current set of spatial filters are determined based on the plurality of spatial filters and a head position of a user. The microphone signals are convolved with the current set of spatial filters, resulting in a left audio channel and right audio channel that form output binaural audio channels. The binaural audio channels can be used to drive speakers of a headphone set to generate sound that is perceived to have a spatial quality. Other aspects are described and claimed.