公开(公告)号：US20240428816A1

公开(公告)日：2024-12-26

申请号：US18797400

申请日：2024-08-07

Applicant: Google LLC

Inventor： Anatoly Efros ,  Noam Etzion-Rosenberg ,  Tal Remez ,  Oran Lang ,  Inbar Mosseri ,  Israel Or Weinstein ,  Benjamin Schlesinger ,  Michael Rubinstein ,  Ariel Ephrat ,  Yukun Zhu ,  Stella Laurenzo ,  Amit Pitaru ,  Yossi Matias

IPC: G10L21/0208 ,  G10L17/00 ,  G10L21/0272 ,  G10L25/57

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for audio-visual speech separation. A method includes: receiving, by a user device, a first indication of one or more first speakers visible in a current view recorded by a camera of the user device, in response, generating a respective isolated speech signal for each of the one or more first speakers that isolates speech of the first speaker in the current view and sending the isolated speech signals for each of the one or more first speakers to a listening device operatively coupled to the user device, receiving, by the user device, a second indication of one or more second speakers visible in the current view recorded by the camera of the user device, and in response generating and sending a respective isolated speech signal for each of the one or more second speakers to the listening device.

公开(公告)号：US12073844B2

公开(公告)日：2024-08-27

申请号：US17601042

申请日：2020-10-01

Applicant: Google LLC

Inventor： Anatoly Efros ,  Noam Etzion-Rosenberg ,  Tal Remez ,  Oran Lang ,  Inbar Mosseri ,  Israel Or Weinstein ,  Benjamin Schlesinger ,  Michael Rubinstein ,  Ariel Ephrat ,  Yukun Zhu ,  Stella Laurenzo ,  Amit Pitaru ,  Yossi Matias

IPC: G10L21/0208 ,  G10L17/00 ,  G10L21/0272 ,  G10L25/57

CPC classification number: G10L21/0208 ,  G10L17/00 ,  G10L21/0272 ,  G10L25/57 ,  G10L2021/02087

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for audio-visual speech separation. A method includes: receiving, by a user device, a first indication of one or more first speakers visible in a current view recorded by a camera of the user device, in response, generating a respective isolated speech signal for each of the one or more first speakers that isolates speech of the first speaker in the current view and sending the isolated speech signals for each of the one or more first speakers to a listening device operatively coupled to the user device, receiving, by the user device, a second indication of one or more second speakers visible in the current view recorded by the camera of the user device, and in response generating and sending a respective isolated speech signal for each of the one or more second speakers to the listening device.

公开(公告)号：US20230267942A1

公开(公告)日：2023-08-24

申请号：US17601042

申请日：2020-10-01

Applicant: Google LLC

Inventor： Anatoly Efros ,  Noam Etzion-Rosenberg ,  Tal Remez ,  Oran Lang ,  Inbar Mosseri ,  Israel Or Weinstein ,  Benjamin Schlesinger ,  Michael Rubinstein ,  Ariel Ephrat ,  Yukun Zhu ,  Stella Laurenzo ,  Amit Pitaru ,  Yossi Matias

IPC: G10L21/0208 ,  G10L25/57

CPC classification number: G10L21/0208 ,  G10L25/57 ,  G10L2021/02087

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for audio-visual speech separation. A method includes: receiving, by a user device, a first indication of one or more first speakers visible in a current view recorded by a camera of the user device, in response, generating a respective isolated speech signal for each of the one or more first speakers that isolates speech of the first speaker in the current view and sending the isolated speech signals for each of the one or more first speakers to a listening device operatively coupled to the user device, receiving, by the user device, a second indication of one or more second speakers visible in the current view recorded by the camera of the user device, and in response generating and sending a respective isolated speech signal for each of the one or more second speakers to the listening device.