公开(公告)号：US20220413696A1

公开(公告)日：2022-12-29

申请号：US17823545

申请日：2022-08-31

Applicant: Google LLC

Inventor： Yu Ouyang ,  Diego Melendo Casado ,  Mohammadinamul Hasan Sheik ,  Francoise Beaufays ,  Dragan Zivkovic ,  Meltem Oktem

IPC: G06F3/04886 ,  G06F3/16 ,  G06F1/16 ,  G06F3/023 ,  G06F3/04883 ,  G06F40/166 ,  G06F40/289

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for cross input modality learning in a mobile device are disclosed. In one aspect, a method includes activating a first modality user input mode in which user inputs by way of a first modality are recognized using a first modality recognizer; and receiving a user input by way of the first modality. The method includes, obtaining, as a result of the first modality recognizer recognizing the user input, a transcription that includes a particular term; and generating an input context data structure that references at least the particular term. The method further includes, transmitting, by the first modality recognizer, the input context data structure to a second modality recognizer for use in updating a second modality recognition model associated with the second modality recognizer.

公开(公告)号：US11842045B2

公开(公告)日：2023-12-12

申请号：US17823545

申请日：2022-08-31

Applicant: Google LLC

Inventor： Yu Ouyang ,  Diego Melendo Casado ,  Mohammadinamul Hasan Sheik ,  Francoise Beaufays ,  Dragan Zivkovic ,  Meltem Oktem

IPC: G06F3/04886 ,  G06F3/16 ,  G06F1/16 ,  G06F3/023 ,  G06F3/04883 ,  G06F40/166 ,  G06F40/289 ,  G10L15/22

CPC classification number: G06F3/04886 ,  G06F1/1626 ,  G06F3/0233 ,  G06F3/04883 ,  G06F3/167 ,  G06F40/166 ,  G06F40/289 ,  G06F2203/0381 ,  G10L15/22

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for cross input modality learning in a mobile device are disclosed. In one aspect, a method includes activating a first modality user input mode in which user inputs by way of a first modality are recognized using a first modality recognizer; and receiving a user input by way of the first modality. The method includes, obtaining, as a result of the first modality recognizer recognizing the user input, a transcription that includes a particular term; and generating an input context data structure that references at least the particular term. The method further includes, transmitting, by the first modality recognizer, the input context data structure to a second modality recognizer for use in updating a second modality recognition model associated with the second modality recognizer.

公开(公告)号：US10831366B2

公开(公告)日：2020-11-10

申请号：US15393676

申请日：2016-12-29

Applicant: Google LLC

Inventor： Yu Ouyang ,  Diego Melendo Casado ,  Mohammadinamul Hasan Sheik ,  Francoise Beaufays ,  Dragan Zivkovic ,  Meltem Oktem

IPC: G06F3/0488 ,  G06F3/16 ,  G06F1/16 ,  G06F3/023 ,  G06F40/166 ,  G06F40/289 ,  G10L15/22

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for cross input modality learning in a mobile device are disclosed. In one aspect, a method includes activating a first modality user input mode in which user inputs by way of a first modality are recognized using a first modality recognizer; and receiving a user input by way of the first modality. The method includes, obtaining, as a result of the first modality recognizer recognizing the user input, a transcription that includes a particular term; and generating an input context data structure that references at least the particular term. The method further includes, transmitting, by the first modality recognizer, the input context data structure to a second modality recognizer for use in updating a second modality recognition model associated with the second modality recognizer.

公开(公告)号：US20240086063A1

公开(公告)日：2024-03-14

申请号：US18517825

申请日：2023-11-22

Applicant: Google LLC

Inventor： Yu Ouyang ,  Diego Melendo Casado ,  Mohammadinamul Hasan Sheik ,  Francoise Beaufays ,  Dragan Zivkovic ,  Meltem Oktem

IPC: G06F3/04886 ,  G06F1/16 ,  G06F3/023 ,  G06F3/04883 ,  G06F3/16 ,  G06F40/166 ,  G06F40/289

CPC classification number: G06F3/04886 ,  G06F1/1626 ,  G06F3/0233 ,  G06F3/04883 ,  G06F3/167 ,  G06F40/166 ,  G06F40/289 ,  G06F2203/0381 ,  G10L15/22

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for cross input modality learning in a mobile device are disclosed. In one aspect, a method includes activating a first modality user input mode in which user inputs by way of a first modality are recognized using a first modality recognizer; and receiving a user input by way of the first modality. The method includes, obtaining, as a result of the first modality recognizer recognizing the user input, a transcription that includes a particular term; and generating an input context data structure that references at least the particular term. The method further includes, transmitting, by the first modality recognizer, the input context data structure to a second modality recognizer for use in updating a second modality recognition model associated with the second modality recognizer.

公开(公告)号：US11435898B2

公开(公告)日：2022-09-06

申请号：US17064173

申请日：2020-10-06

Applicant: Google LLC

Inventor： Yu Ouyang ,  Diego Melendo Casado ,  Mohammadinamul Hasan Sheik ,  Francoise Beaufays ,  Dragan Zivkovic ,  Meltem Oktem

IPC: G06F3/04886 ,  G06F3/16 ,  G06F1/16 ,  G06F3/023 ,  G06F3/04883 ,  G06F40/166 ,  G06F40/289 ,  G10L15/22

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for cross input modality learning in a mobile device are disclosed. In one aspect, a method includes activating a first modality user input mode in which user inputs by way of a first modality are recognized using a first modality recognizer; and receiving a user input by way of the first modality. The method includes, obtaining, as a result of the first modality recognizer recognizing the user input, a transcription that includes a particular term; and generating an input context data structure that references at least the particular term. The method further includes, transmitting, by the first modality recognizer, the input context data structure to a second modality recognizer for use in updating a second modality recognition model associated with the second modality recognizer.

公开(公告)号：US20210019046A1

公开(公告)日：2021-01-21

申请号：US17064173

申请日：2020-10-06

Applicant: Google LLC

Inventor： Yu Ouyang ,  Diego Melendo Casado ,  Mohammadinamul Hasan Sheik ,  Francoise Beaufays ,  Dragan Zivkovic ,  Meltem Oktem

IPC: G06F3/0488 ,  G06F3/16 ,  G06F1/16 ,  G06F3/023 ,  G06F40/166 ,  G06F40/289

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for cross input modality learning in a mobile device are disclosed. In one aspect, a method includes activating a first modality user input mode in which user inputs by way of a first modality are recognized using a first modality recognizer; and receiving a user input by way of the first modality. The method includes, obtaining, as a result of the first modality recognizer recognizing the user input, a transcription that includes a particular term; and generating an input context data structure that references at least the particular term. The method further includes, transmitting, by the first modality recognizer, the input context data structure to a second modality recognizer for use in updating a second modality recognition model associated with the second modality recognizer.