-
公开(公告)号:US20250168567A1
公开(公告)日:2025-05-22
申请号:US19026149
申请日:2025-01-16
Applicant: Magic Leap, Inc.
Inventor: David Thomas ROACH , Jean-Marc JOT , Jung-Suk LEE
Abstract: Disclosed herein are systems and methods for processing speech signals in mixed reality applications. A method may include receiving an audio signal; determining, via first processors, whether the audio signal comprises a voice onset event; in accordance with a determination that the audio signal comprises the voice onset event: waking a second one or more processors; determining, via the second processors, that the audio signal comprises a predetermined trigger signal; in accordance with a determination that the audio signal comprises the predetermined trigger signal: waking third processors; performing, via the third processors, automatic speech recognition based on the audio signal; and in accordance with a determination that the audio signal does not comprise the predetermined trigger signal: forgoing waking the third processors; and in accordance with a determination that the audio signal does not comprise the voice onset event: forgoing waking the second processors.
-
公开(公告)号:US20250126425A1
公开(公告)日:2025-04-17
申请号:US18986468
申请日:2024-12-18
Applicant: Magic Leap, Inc.
Inventor: Remi Samuel AUDFRAY , Jean-Marc JOT , Samuel Charles DICKER
Abstract: Systems and methods for rendering audio signals are disclosed. In some embodiments, a method may receive an input signal including a first portion and the second portion. A first processing stage comprising a first filter is applied to the first portion to generate a first filtered signal. A second processing stage comprising a second filter is applied to the first portion to generate a second filtered signal. A third processing stage comprising a third filter is applied to the second portion to generate a third filtered signal. A fourth processing stage comprising a fourth filter is applied to the second portion to generate a fourth filtered signal. A first output signal is determined based on a sum of the first filtered signal and the third filtered signal. A second output signal is determined based on a sum of the second filtered signal and the fourth filtered signal. The first output signal is presented to a first ear of a user of a virtual environment, and the second output signal is presented to the second ear of the user. The first portion of the input signal corresponds to a first location in the virtual environment, and the second portion of the input signal corresponds to a second location in the virtual environment.
-
公开(公告)号:US20230128286A1
公开(公告)日:2023-04-27
申请号:US18146284
申请日:2022-12-23
Applicant: Magic Leap, Inc.
Inventor: Jean-Marc JOT , Michael MINNICK , Dmitry PASTOUCHENKO , Michael Aaron SIMON , John Emmitt SCOTT, III , Richard St. Clair BAILEY , Shivakumar BALASUBRAMANYAM , Harsharaj AGADI
Abstract: Disclosed herein are systems and methods for presenting audio content in mixed reality environments. A method may include receiving a first input from an application program; in response to receiving the first input, receiving, via a first service, an encoded audio stream; generating, via the first service, a decoded audio stream based on the encoded audio stream; receiving, via a second service, the decoded audio stream; receiving a second input from one or more sensors of a wearable head device; receiving, via the second service, a third input from the application program, wherein the third input corresponds to a position of one or more virtual speakers; generating, via the second service, a spatialized audio stream based on the decoded audio stream, the second input, and the third input; presenting, via one or more speakers of the wearable head device, the spatialized audio stream.
-
公开(公告)号:US20230077524A1
公开(公告)日:2023-03-16
申请号:US18058232
申请日:2022-11-22
Applicant: Magic Leap, Inc.
Inventor: Mathieu PARVAIX , Jean-Marc JOT , Colby Nelson LEIDER
Abstract: Examples of the disclosure describe systems and methods for estimating acoustic properties of an environment. In an example method, a first audio signal is received via a microphone of a wearable head device. An envelope of the first audio signal is determined, and a first reverberation time is estimated based on the envelope of the first audio signal. A difference between the first reverberation time and a second reverberation time is determined. A change in the environment is determined based on the difference between the first reverberation time and the second reverberation time. A second audio signal is presented via a speaker of a wearable head device, wherein the second audio signal is based on the second reverberation time.
-
公开(公告)号:US20230007332A1
公开(公告)日:2023-01-05
申请号:US17943057
申请日:2022-09-12
Applicant: Magic Leap, Inc.
Inventor: Anastasia Andreyevna TAJIK , Jean-Marc JOT
IPC: H04N21/422 , G06F3/16 , H04N21/439
Abstract: A method of presenting an audio signal to a user of a mixed reality environment is disclosed, the method comprising the steps of detecting a first audio signal in the mixed reality environment, where the first audio signal is a real audio signal; identifying a virtual object intersected by the first audio signal in the mixed reality environment; identifying a listener coordinate associated with the user; determining, using the virtual object and the listener coordinate, a transfer function; applying the transfer function to the first audio signal to produce a second audio signal; and presenting, to the user, the second audio signal.
-
公开(公告)号:US20210043223A1
公开(公告)日:2021-02-11
申请号:US16987267
申请日:2020-08-06
Applicant: Magic Leap, Inc.
Inventor: Jung-Suk LEE , Jean-Marc JOT
IPC: G10L25/78 , G10L25/51 , H04R3/00 , H04R3/04 , H04R5/04 , G06F17/18 , G06F3/01 , G02B27/00 , G02B27/01
Abstract: In some embodiments, a first audio signal is received via a first microphone, and a first probability of voice activity is determined based on the first audio signal. A second audio signal is received via a second microphone, and a second probability of voice activity is determined based on the first and second audio signals. Whether a first threshold of voice activity is met is determined based on the first and second probabilities of voice activity. In accordance with a determination that a first threshold of voice activity is met, it is determined that a voice onset has occurred, and an alert is transmitted to a processor based on the determination that the voice onset has occurred. In accordance with a determination that a first threshold of voice activity is not met, it is not determined that a voice onset has occurred.
-
公开(公告)号:US20190387350A1
公开(公告)日:2019-12-19
申请号:US16445163
申请日:2019-06-18
Applicant: Magic Leap, Inc.
Inventor: Remi Samuel AUDFRAY , Jean-Marc JOT , Samuel Charles DICKER , Brian Lloyd SCHMIDT
Abstract: Systems and methods of presenting an output audio signal to a listener located at a first location in a virtual environment are disclosed. According to embodiments of a method, an input audio signal is received. For each sound source of a plurality of sound sources in the virtual environment, a respective first intermediate audio signal corresponding to the input audio signal is determined, based on a location of the respective sound source in the virtual environment, and the respective first intermediate audio signal is associated with a first bus. For each of the sound sources of the plurality of sound sources in the virtual environment, a respective second intermediate audio signal is determined. The respective second intermediate audio signal corresponds to a reverberation of the input audio signal in the virtual environment. The respective second intermediate audio signal is determined based on a location of the respective sound source, and further based on an acoustic property of the virtual environment. The respective second intermediate audio signal is associated with a second bus. The output audio signal is presented to the listener via the first bus and the second bus.
-
公开(公告)号:US20250006219A1
公开(公告)日:2025-01-02
申请号:US18764006
申请日:2024-07-03
Applicant: Magic Leap, Inc.
Inventor: Jung-Suk LEE , Jean-Marc JOT
IPC: G10L25/78 , G02B27/00 , G02B27/01 , G06F3/01 , G06F17/18 , G10L25/51 , H04R3/00 , H04R3/04 , H04R5/04
Abstract: In some embodiments, a first audio signal is received via a first microphone, and a first probability of voice activity is determined based on the first audio signal. A second audio signal is received via a second microphone, and a second probability of voice activity is determined based on the first and second audio signals. Whether a first threshold of voice activity is met is determined based on the first and second probabilities of voice activity. In accordance with a determination that a first threshold of voice activity is met, it is determined that a voice onset has occurred, and an alert is transmitted to a processor based on the determination that the voice onset has occurred. In accordance with a determination that a first threshold of voice activity is not met, it is not determined that a voice onset has occurred.
-
公开(公告)号:US20240282289A1
公开(公告)日:2024-08-22
申请号:US18653795
申请日:2024-05-02
Applicant: Magic Leap, Inc.
Inventor: Remi Samuel AUDFRAY , Jean-Marc JOT , Samuel Charles DICKER
IPC: G10K15/08
CPC classification number: G10K15/08
Abstract: Systems and methods for providing accurate and independent control of reverberation properties are disclosed. In some embodiments, a system may include a reverberation processing system, a direct processing system, and a combiner. The reverberation processing system can include a reverb initial power (RIP) control system and a reverberator. The RIP control system can include a reverb initial gain (RIG) and a RIP corrector. The RIG can be configured to apply a RIG value to the input signal, and the RIP corrector can be configured to apply a RIP correction factor to the signal from the RIG. The reverberator can be configured to apply reverberation effects to the signal from the RIP control system. In some embodiments, one or more values and/or correction factors can be calculated and applied such that the signal output from a component in the reverberation processing system is normalized to a predetermined value (e.g., unity (1.0)).
-
公开(公告)号:US20240163612A1
公开(公告)日:2024-05-16
申请号:US18418131
申请日:2024-01-19
Applicant: Magic Leap, Inc.
Inventor: David Thomas ROACH , Jean-Marc JOT , Jung-Suk LEE
CPC classification number: H04R5/04 , G02B27/0172 , G10L15/08 , H04R3/005 , H04R3/04 , H04R5/033 , G06T19/006
Abstract: Disclosed herein are systems and methods for processing speech signals in mixed reality applications. A method may include receiving an audio signal; determining, via first processors, whether the audio signal comprises a voice onset event; in accordance with a determination that the audio signal comprises the voice onset event: waking a second one or more processors; determining, via the second processors, that the audio signal comprises a predetermined trigger signal; in accordance with a determination that the audio signal comprises the predetermined trigger signal: waking third processors; performing, via the third processors, automatic speech recognition based on the audio signal; and in accordance with a determination that the audio signal does not comprise the predetermined trigger signal: forgoing waking the third processors; and in accordance with a determination that the audio signal does not comprise the voice onset event: forgoing waking the second processors.
-
-
-
-
-
-
-
-
-