公开(公告)号：US11477593B2

公开(公告)日：2022-10-18

申请号：US16703767

申请日：2019-12-04

Applicant: Magic Leap, Inc.

Inventor： George A. Sanger ,  Brian Lloyd Schmidt ,  Anastasia A. Tajik ,  Terry Micheal O'Gara ,  David Matthew Shumway ,  Alan Steven Howarth

IPC: H04S7/00 ,  H04S3/00 ,  H04R5/04 ,  H04R5/027

Abstract: Systems, devices, and methods for capturing audio which can be used in applications such as virtual reality, augmented reality, and mixed reality systems. Some systems can include a plurality of distributed monitoring devices. Each monitoring device can include a microphone and a location tracking unit. The monitoring devices can capture audio signals in an environment, as well as location tracking signals which respectively indicate the locations of the monitoring devices over time during capture of the audio signals. The system can also include a processor to receive the audio signals and the location tracking signals. The processor can determine one or more acoustic properties of the environment based on the audio signals and the location tracking signals.

公开(公告)号：US20220109933A1

公开(公告)日：2022-04-07

申请号：US17517579

申请日：2021-11-02

Applicant: Magic Leap, Inc.

Inventor： Brian Lloyd Schmidt ,  David Thomas Roach ,  Michael Z. Land ,  Richard D. Herr

IPC: H04R5/033 ,  H04R5/04 ,  H04S1/00 ,  H04R3/14 ,  H04R1/10

Abstract: A head-worn sound reproduction device is provided in the form of left and right earphones, which can either be clipped to each ear or mounted on other headgear. The earphones deliver high fidelity audio to a user's eardrums from near-ear range, in a lightweight form factor that is fully “non-blocking” (allows coupling in and natural hearing of ambient sound). Each earphone has a woofer component that produces bass frequencies, and a tweeter component that produces treble frequencies. The woofer outputs the bass frequencies from a position close to the ear canal, while the tweeter outputs treble frequencies from a position that is either close to the ear canal or further away. In certain embodiments, the tweeter is significantly further from the ear canal than the woofer, leading to a more expansive perceived “sound stage”, but still with a “pure” listening experience.

公开(公告)号：US11134357B2

公开(公告)日：2021-09-28

申请号：US16861111

申请日：2020-04-28

Applicant: Magic Leap, Inc.

Inventor： Brian Lloyd Schmidt ,  Samuel Charles Dicker

IPC: H04S7/00 ,  G10L19/008 ,  G10L25/21 ,  H04S3/00

Abstract: An audio system and method of spatially rendering audio signals that uses modified virtual speaker panning is disclosed. The audio system may include a fixed number F of virtual speakers, and the modified virtual speaker panning may dynamically select and use a subset P of the fixed virtual speakers. The subset P of virtual speakers may be selected using a low energy speaker detection and culling method, a source geometry-based culling method, or both. One or more processing blocks in the decoder/virtualizer may be bypassed based on the energy level of the associated audio signal or the location of the sound source relative to the user/listener, respectively. In some embodiments, a virtual speaker that is designated as an active virtual speaker at a first time, may also be designated as an active virtual speaker at a second time to ensure the processing completes.

公开(公告)号：US10667072B2

公开(公告)日：2020-05-26

申请号：US16438358

申请日：2019-06-11

Applicant: Magic Leap, Inc.

Inventor： Brian Lloyd Schmidt ,  Samuel Charles Dicker

IPC: H04S7/00 ,  G10L19/008 ,  G10L25/21 ,  H04S3/00

Abstract: An audio system and method of spatially rendering audio signals that uses modified virtual speaker panning is disclosed. The audio system may include a fixed number F of virtual speakers, and the modified virtual speaker panning may dynamically select and use a subset P of the fixed virtual speakers. The subset P of virtual speakers may be selected using a low energy speaker detection and culling method, a source geometry-based culling method, or both. One or more processing blocks in the decoder/virtualizer may be bypassed based on the energy level of the associated audio signal or the location of the sound source relative to the user/listener, respectively. In some embodiments, a virtual speaker that is designated as an active virtual speaker at a first time, may also be designated as an active virtual speaker at a second time to ensure the processing completes.

公开(公告)号：US12294852B2

公开(公告)日：2025-05-06

申请号：US18461289

申请日：2023-09-05

Applicant: Magic Leap, Inc.

Inventor： Jean-Marc Jot ,  Samuel Charles Dicker ,  Brian Lloyd Schmidt ,  Remi Samuel Audfray

IPC: H04S7/00 ,  G02B27/01 ,  G10K15/10 ,  H04R3/04 ,  H04R3/12 ,  H04R5/033 ,  H04R5/04 ,  H04S3/00

Abstract: Systems and methods of presenting an output audio signal to a listener located at a first location in a virtual environment are disclosed. According to embodiments of a method, an input audio signal is received. For each sound source of a plurality of sound sources in the virtual environment, a respective first intermediate audio signal corresponding to the input audio signal is determined, based on a location of the respective sound source in the virtual environment, and the respective first intermediate audio signal is associated with a first bus. For each of the sound sources of the plurality of sound sources in the virtual environment, a respective second intermediate audio signal is determined. The respective second intermediate audio signal corresponds to a reflection of the input audio signal in a surface of the virtual environment. The respective second intermediate audio signal is determined based on a location of the respective sound source, and further based on an acoustic property of the virtual environment. The respective second intermediate audio signal is associated with a second bus. The output audio signal is presented to the listener via the first bus and the second bus.

公开(公告)号：US20240414493A1

公开(公告)日：2024-12-12

申请号：US18811563

申请日：2024-08-21

Applicant: Magic Leap, Inc.

Inventor： Brian Lloyd Schmidt ,  Samuel Charles Dicker

IPC: H04S7/00 ,  G10L19/008 ,  G10L25/21 ,  H04S3/00

Abstract: An audio system and method of spatially rendering audio signals that uses modified virtual speaker panning is disclosed. The audio system may include a fixed number F of virtual speakers, and the modified virtual speaker panning may dynamically select and use a subset P of the fixed virtual speakers. The subset P of virtual speakers may be selected using a low energy speaker detection and culling method, a source geometry-based culling method, or both. One or more processing blocks in the decoder/virtualizer may be bypassed based on the energy level of the associated audio signal or the location of the sound source relative to the user/listener, respectively. In some embodiments, a virtual speaker that is designated as an active virtual speaker at a first time, may also be designated as an active virtual speaker at a second time to ensure the processing completes.

公开(公告)号：US20240048933A1

公开(公告)日：2024-02-08

申请号：US18486938

申请日：2023-10-13

Applicant: Magic Leap, Inc.

Inventor： Brian Lloyd Schmidt ,  Samuel Charles Dicker

IPC: H04S7/00 ,  G10L19/008 ,  G10L25/21 ,  H04S3/00

CPC classification number: H04S7/303 ,  G10L19/008 ,  G10L25/21 ,  H04S3/008 ,  H04S2400/01 ,  H04S2420/01

Abstract: An audio system and method of spatially rendering audio signals that uses modified virtual speaker panning is disclosed. The audio system may include a fixed number F of virtual speakers, and the modified virtual speaker panning may dynamically select and use a subset P of the fixed virtual speakers. The subset P of virtual speakers may be selected using a low energy speaker detection and culling method, a source geometry-based culling method, or both. One or more processing blocks in the decoder/virtualizer may be bypassed based on the energy level of the associated audio signal or the location of the sound source relative to the user/listener, respectively. In some embodiments, a virtual speaker that is designated as an active virtual speaker at a first time, may also be designated as an active virtual speaker at a second time to ensure the processing completes.

公开(公告)号：US11546714B2

公开(公告)日：2023-01-03

申请号：US17412084

申请日：2021-08-25

Applicant: Magic Leap, Inc.

Inventor： Brian Lloyd Schmidt ,  Samuel Charles Dicker

IPC: H04S7/00 ,  G10L19/008 ,  G10L25/21 ,  H04S3/00

Abstract: An audio system and method of spatially rendering audio signals that uses modified virtual speaker panning is disclosed. The audio system may include a fixed number F of virtual speakers, and the modified virtual speaker panning may dynamically select and use a subset P of the fixed virtual speakers. The subset P of virtual speakers may be selected using a low energy speaker detection and culling method, a source geometry-based culling method, or both. One or more processing blocks in the decoder/virtualizer may be bypassed based on the energy level of the associated audio signal or the location of the sound source relative to the user/listener, respectively. In some embodiments, a virtual speaker that is designated as an active virtual speaker at a first time, may also be designated as an active virtual speaker at a second time to ensure the processing completes.

公开(公告)号：US10863301B2

公开(公告)日：2020-12-08

申请号：US16803301

申请日：2020-02-27

Applicant: Magic Leap, Inc.

Inventor： Brian Lloyd Schmidt ,  Jehangir Tajik ,  Jean-Marc Jot

IPC: H04S7/00 ,  H04S3/00 ,  G06F3/01 ,  H04R5/033

Abstract: A method of presenting an audio signal to a user of a mixed reality environment is disclosed. According to examples of the method, an audio event associated with the mixed reality environment is detected. The audio event is associated with a first audio signal. A location of the user with respect to the mixed reality environment is determined. An acoustic region associated with the location of the user is identified. A first acoustic parameter associated with the first acoustic region is determined. A transfer function is determined using the first acoustic parameter. The transfer function is applied to the first audio signal to produce a second audio signal, which is then presented to the user.

公开(公告)号：US20190011703A1

公开(公告)日：2019-01-10

申请号：US15657589

申请日：2017-07-24

Applicant: Magic Leap, Inc.

Inventor： Nastasja U. Robaina ,  Nicole Elizabeth Samec ,  Christopher M. Harrises ,  Rony Abovitz ,  Mark Baerenrodt ,  Brian Lloyd Schmidt

IPC: G02B27/01 ,  G06T19/00 ,  G06F3/01

Abstract: A display system can include a head-mounted display configured to project light to an eye of a user to display augmented reality image content to the user. The display system can include one or more user sensors configured to sense the user and can include one or more environmental sensors configured to sense surroundings of the user. The display system can also include processing electronics in communication with the display, the one or more user sensors, and the one or more environmental sensors. The processing electronics can be configured to sense a situation involving user focus, determine user intent for the situation, and alter user perception of a real or virtual object within the vision field of the user based at least in part on the user intent and/or sensed situation involving user focus. The processing electronics can be configured to at least one of enhance or de-emphasize the user perception of the real or virtual object within the vision field of the user.