公开(公告)号：US20220394405A1

公开(公告)日：2022-12-08

申请号：US17892310

申请日：2022-08-22

Applicant: Meta Platforms Technologies, LLC

Inventor： William Owen Brimijoin, II ,  Samuel Clapp ,  Peter Harty Dodds ,  Nava K. Balsam ,  Tomasz Rudzki ,  Ryan Rohrer ,  Kevin Scheumann ,  Michaela Warnecke

IPC: H04S1/00

Abstract: A system is disclosed for using an audio time and level difference renderer (TLDR) to generate spatialized audio content for multiple channels from an audio signal received at a single channel. The system selects an audio TLDR from a set of audio TLDRs based on received input parameters. The system configures the selected audio TLDR based on received input parameters using a filter parameter model to generate a configured audio TLDR that comprises a set of configured binaural dynamic filters, and a configured delay between the multiple channel. The system applies the configured audio TLDR to an audio signal received at the single channel to generate spatialized multiple channel audio content for each channel of the multiple audio channel and presents the generated spatialized audio content at multiple channels to a user via a headset.

公开(公告)号：US11659324B1

公开(公告)日：2023-05-23

申请号：US17503565

申请日：2021-10-18

Applicant: META PLATFORMS TECHNOLOGIES, LLC

Inventor： Jacob Ryan Donley ,  Nava K. Balsam ,  Vladimir Tourbabin

IPC: H04R1/40

CPC classification number: H04R1/406

Abstract: A system and method for storing data samples in discrete poses and recalling the stored data samples for updating a sound filter. The system determines that a microphone array at a first time period is in a first discrete pose of a plurality of discrete poses, wherein the plurality of discrete poses discretizes a pose space. The pose space includes at least an orientation component and may further include a translation component. The system retrieves one or more historical data samples associated with the first discrete pose, generated from sound captured by the microphone array before the first time period, and stored in a memory cache (e.g., for memorization). The system updates a sound filter for the first discrete pose using the retrieved one or more historical data samples. The system generates and presents audio content using the updated sound filter.

公开(公告)号：US20240311075A1

公开(公告)日：2024-09-19

申请号：US18122071

申请日：2023-03-15

Applicant: Meta Platforms Technologies, LLC

Inventor： Nava K. Balsam ,  Khia Johnson ,  Haniyeh Salehi ,  Ishwarya Ananthabhotla ,  Antje Ihlefeld

IPC: G06F3/16 ,  G06F3/01

CPC classification number: G06F3/165 ,  G06F3/013

Abstract: Audio data comprising speech is received at a first client device executing an application in an artificial reality environment, in which the first client device is associated with a speaking user. A determination is then made as to whether an object associated with the speaking user is within a field of view of a listening user of a second client device executing the application. The audio data is modified based at least in part on a set of rules and whether the object associated with the speaking user is within the field of view of the listening user. The modified data is then communicated to the listening user of the second client device.

公开(公告)号：US11457325B2

公开(公告)日：2022-09-27

申请号：US17379730

申请日：2021-07-19

Applicant: Meta Platforms Technologies, LLC

Inventor： William Owen Brimijoin, II ,  Samuel Clapp ,  Peter Dodds ,  Nava K. Balsam ,  Tomasz Rudzki ,  Ryan Rohrer ,  Kevin Scheumann ,  Michaela Warnecke

IPC: H04S1/00

Abstract: A system is disclosed for using an audio time and level difference renderer (TLDR) to generate spatialized audio content for multiple channels from an audio signal received at a single channel. The system selects an audio TLDR from a set of audio TLDRs based on received input parameters. The system configures the selected audio TLDR based on received input parameters using a filter parameter model to generate a configured audio TLDR that comprises a set of configured binaural dynamic filters, and a configured delay between the multiple channel. The system applies the configured audio TLDR to an audio signal received at the single channel to generate spatialized multiple channel audio content for each channel of the multiple audio channel and presents the generated spatialized audio content at multiple channels to a user via a headset.

公开(公告)号：US20240311076A1

公开(公告)日：2024-09-19

申请号：US18122371

申请日：2023-03-16

Applicant: Meta Platforms Technologies, LLC

Inventor： Nava K. Balsam ,  Khia Johnson ,  Haniyeh Salehi ,  Ishwarya Ananthabhotla ,  Antje Ihlefeld

IPC: G06F3/16 ,  G06F3/01 ,  G06F40/58 ,  G10L15/00 ,  G10L15/22 ,  H04R1/10

CPC classification number: G06F3/165 ,  G06F3/013 ,  G06F40/58 ,  G10L15/005 ,  G10L15/22 ,  H04R1/1041

Abstract: An eye tracking system tracks a position and an orientation of one or more eyes of a user of the eye tracking system and determines a gaze point of the user based on the position and the orientation of the user's eye(s). An audio system coupled to the eye tracking system then detects a sound in an environment of the user. A change in the gaze point of the user is detected at the eye tracking system. Based on the change in the gaze point, a determination is made as to whether the user's attention has shifted. Responsive to determining the user's attention has shifted, the sound is modified at the audio system and the modified sound is then communicated to the user.

公开(公告)号：US20240310175A1

公开(公告)日：2024-09-19

申请号：US18122073

申请日：2023-03-15

Applicant: Meta Platforms Technologies, LLC

Inventor： Nava K. Balsam ,  Khia Johnson ,  Haniyeh Salehi ,  Ishwarya Ananthabhotla ,  Antje Ihlefeld

IPC: G01C21/20 ,  G06V10/94 ,  G06V20/20 ,  G06V20/40 ,  H04S7/00

CPC classification number: G01C21/206 ,  G06V10/945 ,  G06V20/20 ,  G06V20/40 ,  H04S7/303 ,  G06V10/774

Abstract: An artificial reality system receives information identifying a physical object and location information describing a geographical location associated with the artificial reality system, in which the information identifying the physical object includes a trackable feature associated with the physical object. Upon receiving a request from a user to locate the physical object, the artificial reality system determines a most recent geographical location associated with the physical object based at least in part on the trackable feature and the location information. The artificial reality system then communicates a set of spatial audio cues to the user, in which the set of spatial audio cues guides the user to the most recent geographical location associated with the physical object.

公开(公告)号：US12069463B2

公开(公告)日：2024-08-20

申请号：US17892310

申请日：2022-08-22

Applicant: Meta Platforms Technologies, LLC

Inventor： William Owen Brimijoin, II ,  Samuel Clapp ,  Peter Harty Dodds ,  Nava K. Balsam ,  Tomasz Rudzki ,  Ryan Rohrer ,  Kevin Scheumann ,  Michaela Warnecke

IPC: H04S1/00

CPC classification number: H04S1/005 ,  H04S2420/01

Abstract: A system is disclosed for using an audio time and level difference renderer (TLDR) to generate spatialized audio content for multiple channels from an audio signal received at a single channel. The system selects an audio TLDR from a set of audio TLDRs based on received input parameters. The system configures the selected audio TLDR based on received input parameters using a filter parameter model to generate a configured audio TLDR that comprises a set of configured binaural dynamic filters, and a configured delay between the multiple channel. The system applies the configured audio TLDR to an audio signal received at the single channel to generate spatialized multiple channel audio content for each channel of the multiple audio channel and presents the generated spatialized audio content at multiple channels to a user via a headset.

公开(公告)号：US20230320669A1

公开(公告)日：2023-10-12

申请号：US17714971

申请日：2022-04-06

Applicant: META PLATFORMS TECHNOLOGIES, LLC

Inventor： Maansi Desai ,  Antje Ihlefeld ,  Morteza Khaleghimeybodi ,  Srinivas Kota ,  Nava K. Balsam

IPC: A61B5/00 ,  A61B5/372 ,  A61B5/291 ,  H04R29/00

CPC classification number: A61B5/7221 ,  A61B5/372 ,  A61B5/291 ,  A61B5/6803 ,  A61B5/6817 ,  A61B5/7405 ,  H04R29/001

Abstract: A real-time in-ear EEG signal verification system. The system includes an in-ear device (IED) configured to be placed within an ear canal of a user and a controller. The IED includes a speaker configured to present a calibration audio signal to the user, the calibration audio signal being embedded with a predetermined audible feature, and an in-ear electrode configured to be in contact with an inner surface of the ear canal. The controller is configured to instruct the speaker to present the calibration audio signal to the user, and generate neural signal data based on electrical signals from the in-ear electrode. The electrical signals correspond to brain activity of the user in response to the predetermined audible feature. The controller is configured to determine a quality of the generated neural signal data, and perform an action based on the quality of the neural signal data.

公开(公告)号：US20230111835A1

公开(公告)日：2023-04-13

申请号：US17499685

申请日：2021-10-12

Applicant: Meta Platforms Technologies, LLC

Inventor： Nava K. Balsam ,  Michaela Warnecke ,  Aminata Dia ,  Dianmin Lin

IPC: G06F3/01 ,  G09G3/00 ,  A61B3/10 ,  A61B5/00

Abstract: Methods, systems, and storage media for eye tracking in artificial reality (e.g., virtual reality, augmented reality, mixed reality, etc.) headsets are disclosed. Exemplary implementations may: generate a simulated environment for a user through an artificial reality headset; track an eye of the user through an eye sensor responsive to the artificial reality headset being worn by the user; detect a physical aspect of the eye through the eye sensor indicative of an eye malady; and adjust a display setting of the artificial reality headset based at least in part on the detected physical aspect of the eye.