公开(公告)号：US20200276704A1

公开(公告)日：2020-09-03

申请号：US16649598

申请日：2018-09-21

Applicant: GOOGLE LLC

Inventor： Vikas Sindhwani ,  Atil Iscen ,  Krzysztof Marcin Choromanski

IPC: B25J9/16 ,  G06N3/08

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for optimizing the determination of control policies for robots through the performance of simulations of robots and real-world context to determine control policy parameters.

公开(公告)号：US20240403636A1

公开(公告)日：2024-12-05

申请号：US18697257

申请日：2022-10-05

Applicant: GOOGLE LLC

Inventor： Valerii Likhosherstov ,  Mostafa Dehghani ,  Anurag Arnab ,  Krzysztof Marcin Choromanski ,  Mario Lucic ,  Yi Tay

IPC: G06N3/08 ,  G06N3/045

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for executing and training a multi-modal, multi-task self-attention neural network.

公开(公告)号：US12079700B2

公开(公告)日：2024-09-03

申请号：US15793455

申请日：2017-10-25

Applicant: GOOGLE LLC

Inventor： Daniel Holtmann-Rice ,  Sanjiv Kumar ,  Xinnan Yu ,  Krzysztof Marcin Choromanski ,  Ananda Theertha Suresh

IPC: G06N20/10 ,  G06F17/14 ,  G06F17/16 ,  G06F17/17 ,  G06F18/00 ,  G06N20/00

CPC classification number: G06N20/10 ,  G06F17/14 ,  G06F17/16 ,  G06F17/175 ,  G06F18/00 ,  G06N20/00

Abstract: Techniques of generating input for a kernel-based machine learning system that uses a kernel to perform classification operations on data involve generating unbiased estimators for gaussian kernels according to a new framework called Structured Orthogonal Random Features (SORF). The unbiased estimator KSORF to the kernel involves a linear transformation matrix WSORF computed using products of a set of pairs of matrices, each pair including an orthogonal matrix and respective diagonal matrix whose elements are real numbers following a specified probability distribution. Typically, the orthogonal matrix is a Walsh-Hadamard matrix, the specified probability distribution is a Rademacher distribution, and there are at least two, usually three, pairs of matrices multiplied together to form the linear transformation matrix WSORF.

公开(公告)号：US20240256865A1

公开(公告)日：2024-08-01

申请号：US18430586

申请日：2024-02-01

Applicant: Google LLC

Inventor： Deepali Jain ,  Krzysztof Marcin Choromanski ,  Sumeet Singh ,  Vikas Sindhwani ,  Tingnan Zhang ,  Jie Tan ,  Kumar Avinava Dubey

IPC: G06N3/08 ,  G06N3/0455

CPC classification number: G06N3/08 ,  G06N3/0455

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for training neural networks. One of the methods for training a neural network configured to perform a machine learning task includes performing, at each of a plurality of iterations: performing a training step to obtain respective new gradients of a loss function; for each network parameter: generating an optimizer network input; processing the optimizer network input using an optimizer neural network, wherein the processing comprises, for each cell: generating a cell input for the cell; and processing the cell input for the cell to generate a cell output, wherein the processing comprises: obtaining latent embeddings from the cell input; generating the cell output from the hidden state; and determining an update to the hidden state; and generating an optimizer network output defining an update for the network parameter; and applying the update to the network parameter.

公开(公告)号：US11697205B2

公开(公告)日：2023-07-11

申请号：US16649598

申请日：2018-09-21

Applicant: GOOGLE LLC

Inventor： Vikas Sindhwani ,  Atil Iscen ,  Krzysztof Marcin Choromanski

IPC: G06N3/08 ,  B25J9/16 ,  G06N20/00

CPC classification number: B25J9/163 ,  B25J9/1661 ,  B25J9/1671 ,  G06N3/08 ,  G06N20/00

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for optimizing the determination of control policies for robots through the performance of simulations of robots and real-world context to determine control policy parameters.