公开(公告)号：US20180047395A1

公开(公告)日：2018-02-15

申请号：US15673894

申请日：2017-08-10

Applicant: Magic Leap, Inc.

Inventor： Jeffrey Sommers ,  Jennifer M.R. Devine ,  Joseph Wayne Seuck ,  Adrian Kaehler

IPC: G10L15/26 ,  G06F17/24 ,  H04N7/15 ,  G10L15/18 ,  G06F17/28 ,  G10L25/84 ,  G06K9/00

CPC classification number: G10L15/265 ,  G06F17/241 ,  G06F17/2735 ,  G06F17/289 ,  G06K9/00671 ,  G10L15/1815 ,  G10L15/26 ,  G10L25/84 ,  G10L2015/088 ,  H04N7/142 ,  H04N7/157

Abstract: An augmented reality (AR) device can be configured to monitor ambient audio data. The AR device can detect speech in the ambient audio data, convert the detected speech into text, or detect keywords such as rare words in the speech. When a rare word is detected, the AR device can retrieve auxiliary information (e.g., a definition) related to the rare word from a public or private source. The AR device can display the auxiliary information for a user to help the user better understand the speech. The AR device may perform translation of foreign speech, may display text (or the translation) of a speaker's speech to the user, or display statistical or other information associated with the speech.

公开(公告)号：US11423909B2

公开(公告)日：2022-08-23

申请号：US16791855

申请日：2020-02-14

Applicant: Magic Leap, Inc.

Inventor： Jeffrey Scott Sommers ,  Jennifer M. R. Devine ,  Joseph Wayne Seuck ,  Adrian Kaehler

IPC: G10L15/26 ,  G06F40/58 ,  G06F40/169 ,  G06F40/242 ,  G06V20/20 ,  G10L15/18 ,  G10L25/84 ,  H04N7/15 ,  H04N7/14 ,  G10L15/08

Abstract: An augmented reality (AR) device can be configured to monitor ambient audio data. The AR device can detect speech in the ambient audio data, convert the detected speech into text, or detect keywords such as rare words in the speech. When a rare word is detected, the AR device can retrieve auxiliary information (e.g., a definition) related to the rare word from a public or private source. The AR device can display the auxiliary information for a user to help the user better understand the speech. The AR device may perform translation of foreign speech, may display text (or the translation) of a speaker's speech to the user, or display statistical or other information associated with the speech.

公开(公告)号：US10607609B2

公开(公告)日：2020-03-31

申请号：US15673894

申请日：2017-08-10

Applicant: Magic Leap, Inc.

Inventor： Jeffrey Sommers ,  Jennifer M. R. Devine ,  Joseph Wayne Seuck ,  Adrian Kaehler

IPC: G10L15/26 ,  G06F17/24 ,  G06F17/28 ,  G06K9/00 ,  G10L25/84 ,  G10L15/18 ,  H04N7/15 ,  G10L15/08

Abstract: An augmented reality (AR) device can be configured to monitor ambient audio data. The AR device can detect speech in the ambient audio data, convert the detected speech into text, or detect keywords such as rare words in the speech. When a rare word is detected, the AR device can retrieve auxiliary information (e.g., a definition) related to the rare word from a public or private source. The AR device can display the auxiliary information for a user to help the user better understand the speech. The AR device may perform translation of foreign speech, may display text (or the translation) of a speaker's speech to the user, or display statistical or other information associated with the speech.

公开(公告)号：US20220327281A1

公开(公告)日：2022-10-13

申请号：US17850860

申请日：2022-06-27

Applicant: Magic Leap, Inc.

Inventor： Jeffrey Scott Sommers ,  Jennifer M.R. Devine ,  Joseph Wayne Seuck ,  Adrian Kaehler

IPC: G06F40/169 ,  G06F40/242 ,  H04N7/15 ,  G06F40/58 ,  G10L15/18 ,  G10L25/84 ,  G10L15/26 ,  G06V20/20 ,  G10L15/08 ,  H04N7/14

Abstract: An augmented reality (AR) device can be configured to monitor ambient audio data. The AR device can detect speech in the ambient audio data, convert the detected speech into text, or detect keywords such as rare words in the speech. When a rare word is detected, the AR device can retrieve auxiliary information (e.g., a definition) related to the rare word from a public or private source. The AR device can display the auxiliary information for a user to help the user better understand the speech. The AR device may perform translation of foreign speech, may display text (or the translation) of a speaker's speech to the user, or display statistical or other information associated with the speech.

公开(公告)号：US20200184975A1

公开(公告)日：2020-06-11

申请号：US16791855

申请日：2020-02-14

Applicant: Magic Leap, Inc.

Inventor： Jeffrey Scott Sommers ,  Jennifer M.R. Devine ,  Joseph Wayne Seuck ,  Adrian Kaehler

IPC: G10L15/26 ,  H04N7/15 ,  G10L25/84 ,  G10L15/18 ,  G06K9/00 ,  G06F40/242 ,  G06F40/169 ,  G06F40/58

Abstract: An augmented reality (AR) device can be configured to monitor ambient audio data. The AR device can detect speech in the ambient audio data, convert the detected speech into text, or detect keywords such as rare words in the speech. When a rare word is detected, the AR device can retrieve auxiliary information (e.g., a definition) related to the rare word from a public or private source. The AR device can display the auxiliary information for a user to help the user better understand the speech. The AR device may perform translation of foreign speech, may display text (or the translation) of a speaker's speech to the user, or display statistical or other information associated with the speech.