公开(公告)号：US20180188948A1

公开(公告)日：2018-07-05

申请号：US15393676

申请日：2016-12-29

Applicant: Google Inc.

Inventor： Yu Ouyang ,  Diego Melendo Casado ,  Mohammadinamul Hasan Sheik ,  Francoise Beaufays ,  Dragan Zivkovic ,  Meltem Oktem

IPC: G06F3/0488 ,  G06F3/16 ,  G06F17/24 ,  G06F17/27

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for cross input modality learning in a mobile device are disclosed. In one aspect, a method includes activating a first modality user input mode in which user inputs by way of a first modality are recognized using a first modality recognizer; and receiving a user input by way of the first modality. The method includes, obtaining, as a result of the first modality recognizer recognizing the user input, a transcription that includes a particular term; and generating an input context data structure that references at least the particular term. The method further includes, transmitting, by the first modality recognizer, the input context data structure to a second modality recognizer for use in updating a second modality recognition model associated with the second modality recognizer.