公开(公告)号：US10733535B1

公开(公告)日：2020-08-04

申请号：US15665236

申请日：2017-07-31

Applicant: Google LLC

Inventor： Gregory S. Corrado ,  Kai Chen ,  Jeffrey A. Dean ,  Samy Bengio ,  Rajat Monga ,  Matthieu Devin

IPC: G06F15/18 ,  G06N20/00 ,  G06N7/08 ,  G06K9/62 ,  G06N7/00 ,  G06N5/02

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for training a model using parameter server shards. One of the methods includes receiving, at a parameter server shard configured to maintain values of a disjoint partition of the parameters of the model, a succession of respective requests for parameter values from each of a plurality of replicas of the model; in response to each request, downloading a current value of each requested parameter to the replica from which the request was received; receiving a succession of uploads, each upload including respective delta values for each of the parameters in the partition maintained by the shard; and updating values of the parameters in the partition maintained by the parameter server shard repeatedly based on the uploads of delta values to generate current parameter values.

公开(公告)号：US11847176B1

公开(公告)日：2023-12-19

申请号：US16227086

申请日：2018-12-20

Applicant: Google LLC

Inventor： Lawrence J. Brunsman ,  Matthieu Devin ,  Uri N. Lerner ,  Simon Tong

IPC: G06F16/951 ,  G06F16/33 ,  G06F16/24 ,  G06F40/232 ,  G06F40/295 ,  G06F40/247

CPC classification number: G06F16/951 ,  G06F16/24 ,  G06F16/3338 ,  G06F40/232 ,  G06F40/295 ,  G06F40/247

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for correcting entity names. One method includes receiving texts and deriving a plurality of name-context pairs from the texts. The method further includes calculating a context consistency measure for each name-context pair and storing context-entity name data representing the name-context pairs. Another method includes identifying an entity name and one or more context terms from a query and generating candidate names for the entity name. The method further includes determining a score for each of the candidate names, selecting a number of top scoring candidate names, and using the selected candidate names to respond to the query.

公开(公告)号：US11687832B1

公开(公告)日：2023-06-27

申请号：US16983979

申请日：2020-08-03

Applicant: Google LLC

Inventor： Gregory S. Corrado ,  Kai Chen ,  Jeffrey A. Dean ,  Samy Bengio ,  Rajat Monga ,  Matthieu Devin

IPC: G06N20/00 ,  G06N3/063 ,  G06N3/08 ,  G06N7/08 ,  G06N5/025 ,  G06F18/214 ,  G06F18/2411 ,  G06N7/01

CPC classification number: G06N20/00 ,  G06N3/063 ,  G06N3/08 ,  G06N7/08 ,  G06F18/214 ,  G06F18/2411 ,  G06N5/025 ,  G06N7/01

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for training a model using parameter server shards. One of the methods includes receiving, at a parameter server shard configured to maintain values of a disjoint partition of the parameters of the model, a succession of respective requests for parameter values from each of a plurality of replicas of the model; in response to each request, downloading a current value of each requested parameter to the replica from which the request was received; receiving a succession of uploads, each upload including respective delta values for each of the parameters in the partition maintained by the shard; and updating values of the parameters in the partition maintained by the parameter server shard repeatedly based on the uploads of delta values to generate current parameter values.

公开(公告)号：US10162895B1

公开(公告)日：2018-12-25

申请号：US14616915

申请日：2015-02-09

Applicant: Google LLC

Inventor： Lawrence J. Brunsman ,  Matthieu Devin ,  Uri N. Lerner ,  Simon Tong

IPC: G06F7/00 ,  G06F17/30

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for correcting entity names. One method includes receiving texts and deriving a plurality of name-context pairs from the texts. The method further includes calculating a context consistency measure for each name-context pair and storing context-entity name data representing the name-context pairs. Another method includes identifying an entity name and one or more context terms from a query and generating candidate names for the entity name. The method further includes determining a score for each of the candidate names, selecting a number of top scoring candidate names, and using the selected candidate names to respond to the query.