公开(公告)号：US12039286B2

公开(公告)日：2024-07-16

申请号：US17700123

申请日：2022-03-21

Applicant: GOOGLE LLC

Inventor： Markus Freitag ,  Isaac Caswell ,  Howard Scott Roy

IPC: G06F40/51 ,  G06F40/166 ,  G06F40/253 ,  G06F40/58 ,  G10L13/00

CPC classification number: G06F40/51 ,  G06F40/166 ,  G06F40/253 ,  G06F40/58 ,  G10L13/00

Abstract: Techniques are disclosed for training and/or utilizing an automatic post-editing model in correcting translation error(s) introduced by a neural machine translation model. The automatic post-editing model can be trained using automatically generated training instances. A training instance is automatically generated by processing text in a first language using a neural machine translation model to generate text in a second language. The text in the second language is processed using a neural machine translation model to generate training text in the first language. A training instance can include the text in the first language as well as the training text in the first language.

公开(公告)号：US20220215183A1

公开(公告)日：2022-07-07

申请号：US17700123

申请日：2022-03-21

Applicant: GOOGLE LLC

Inventor： Markus Freitag ,  Isaac Caswell ,  Howard Scott Roy

IPC: G06F40/51 ,  G06F40/58 ,  G10L13/00

Abstract: Techniques are disclosed for training and/or utilizing an automatic post-editing model in correcting translation error(s) introduced by a neural machine translation model. The automatic post-editing model can be trained using automatically generated training instances. A training instance is automatically generated by processing text in a first language using a neural machine translation model to generate text in a second language. The text in the second language is processed using a neural machine translation model to generate training text in the first language. A training instance can include the text in the first language as well as the training text in the first language.

公开(公告)号：US20210019373A1

公开(公告)日：2021-01-21

申请号：US16511806

申请日：2019-07-15

Applicant: Google LLC

Inventor： Markus Freitag ,  Isaac Caswell ,  Howard Scott Roy

IPC: G06F17/28 ,  G10L13/04

Abstract: Techniques are disclosed for training and/or utilizing an automatic post-editing model in correcting translation error(s) introduced by a neural machine translation model. The automatic post-editing model can be trained using automatically generated training instances. A training instance is automatically generated by processing text in a first language using a neural machine translation model to generate text in a second language. The text in the second language is processed using a neural machine translation model to generate training text in the first language. A training instance can include the text in the first language as well as the training text in the first language.

公开(公告)号：US12073187B2

公开(公告)日：2024-08-27

申请号：US17608616

申请日：2019-08-22

Applicant: GOOGLE LLC

Inventor： Markus Freitag ,  Howard Scott Roy

IPC: G06F40/56 ,  G06F40/226 ,  G06F40/30

CPC classification number: G06F40/56 ,  G06F40/226 ,  G06F40/30

Abstract: Techniques are disclosed for training and/or utilizing an alignments and language model (“ALM”) in automatically determining an ALM score corresponding with natural language text generated using a natural language generation model. The natural language text generated using the natural language generation model can be based on a set of structured data. Additionally or alternatively, the ALM can include a fluency model portion and a semantics model portion. The fluency model portion can be used in determining the fluency and/or grammar of the text. The semantics model portion be used in evaluating the content of the natural language text with respect to the content of the structured data.

公开(公告)号：US11295092B2

公开(公告)日：2022-04-05

申请号：US16511806

申请日：2019-07-15

Applicant: Google LLC

Inventor： Markus Freitag ,  Isaac Caswell ,  Howard Scott Roy

IPC: G06F40/51 ,  G06F40/58 ,  G10L13/00

Abstract: Techniques are disclosed for training and/or utilizing an automatic post-editing model in correcting translation error(s) introduced by a neural machine translation model. The automatic post-editing model can be trained using automatically generated training instances. A training instance is automatically generated by processing text in a first language using a neural machine translation model to generate text in a second language. The text in the second language is processed using a neural machine translation model to generate training text in the first language. A training instance can include the text in the first language as well as the training text in the first language.

公开(公告)号：US10083169B1

公开(公告)日：2018-09-25

申请号：US15248966

申请日：2016-08-26

Applicant: Google LLC

Inventor： Shalini Ghosh ,  Oriol Vinyals ,  Brian Patrick Strope ,  Howard Scott Roy ,  Thomas L. Dean ,  Larry Paul Heck

IPC: G10L15/00 ,  G06F17/27 ,  G06N3/08 ,  G06N3/04

CPC classification number: G06F17/279 ,  G06F17/2881 ,  G06N3/0445 ,  G06N3/084

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for processing word sequences using neural networks. One of the methods includes receiving a first sequence of words arranged according to a first order; and for each word in the first sequence, beginning with a first word in the first order: determining a topic vector that is associated with the word; generating a combined input from the word and the topic vector, and processing the combined input through one or more sequence modeling layers to generate a sequence modeling output for the word; and processing one or more of the sequence modeling outputs through an output layer to generate a neural network output for the first sequence of words.

公开(公告)号：US20240370666A1

公开(公告)日：2024-11-07

申请号：US18773129

申请日：2024-07-15

Applicant: GOOGLE LLC

Inventor： Markus Freitag ,  Isaac Caswell ,  Howard Scott Roy

IPC: G06F40/51 ,  G06F40/166 ,  G06F40/253 ,  G06F40/58 ,  G10L13/00

Abstract: Techniques are disclosed for training and/or utilizing an automatic post-editing model in correcting translation error(s) introduced by a neural machine translation model. The automatic post-editing model can be trained using automatically generated training instances. A training instance is automatically generated by processing text in a first language using a neural machine translation model to generate text in a second language. The text in the second language is processed using a neural machine translation model to generate training text in the first language. A training instance can include the text in the first language as well as the training text in the first language.

公开(公告)号：US20220215184A1

公开(公告)日：2022-07-07

申请号：US17608616

申请日：2019-08-22

Applicant: GOOGLE LLC

Inventor： Markus Freitag ,  Howard Scott Roy

IPC: G06F40/56 ,  G06F40/226 ,  G06F40/30

Abstract: Techniques are disclosed for training and/or utilizing an alignments and language model (“ALM”) in automatically determining an ALM score corresponding with natural language text generated using a natural language generation model. The natural language text generated using the natural language generation model can be based on a set of structured data. Additionally or alternatively, the ALM can include a fluency model portion and a semantics model portion. The fluency model portion can be used in determining the fluency and/or grammar of the text. The semantics model portion be used in evaluating the content of the natural language text with respect to the content of the structured data.

公开(公告)号：US10719667B1

公开(公告)日：2020-07-21

申请号：US14818579

申请日：2015-08-05

Applicant: Google LLC

Inventor： Howard Scott Roy

IPC: G06F17/27 ,  G06F40/40 ,  G06F16/9032

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for providing a natural language based program interface to software applications. One of the methods includes, obtaining, via a natural language front end, a natural language query or a natural language update statement issued by a software application; converting the natural language query or natural language update statement into structured operations to be performed on APIs of a knowledge base; performing the structured operations on the APIs to produce a natural language output statement; and providing, via a natural language output interface, the natural language output statement to the software application. The knowledge base stores entity information according to a data schema and has structured APIs for use by software applications to query the knowledge base; the software applications are limited to communicating with the knowledge base through the interfaces provided by the natural language front end.