公开(公告)号：US20240273270A1

公开(公告)日：2024-08-15

申请号：US18564797

申请日：2022-05-31

Applicant: Google LLC

Inventor： Shobha Vasudevan ,  Wenjie Jiang ,  Charles Aloysius Sutton ,  Rishabh Singh ,  David Bieber ,  Milad Olia Hashemi ,  Chian-min Richard Ho ,  Hamid Shojaei

IPC: G06F30/323 ,  G06F30/33

CPC classification number: G06F30/323 ,  G06F30/33

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for generating learned representations of digital circuit designs. One of the systems includes obtaining data representing a program that implements a digital circuit design, the program comprising a plurality of statements; processing the obtained data to generate data representing a graph representing the digital circuit design, the graph comprising: a plurality of nodes representing respective statements of the program, a plurality of first edges each representing a control flow between a pair of statements of the program, and a plurality of second edges each representing a data flow between a pair of statements of the program; and generating a learned representation of the digital circuit design, comprising processing the data representing the graph using a graph neural network to generate a respective learned representation of each statement represented by a node of the graph.

公开(公告)号：US20250094838A1

公开(公告)日：2025-03-20

申请号：US18967327

申请日：2024-12-03

Applicant: Google LLC

Inventor： Jason Weng Wei ,  Dengyong Zhou ,  Xuezhi Wang ,  Dale Eric Schuurmans ,  Quoc V. Le ,  Maarten Paul Bosma ,  Ed Huai-Hsin Chi ,  Olivier Jean Andrè Bousquet ,  Le Hou ,  Charles Aloysius Sutton ,  Nathanael Martin Schärli ,  Nathan Kemp Sekiguchi Scales ,  Augustus Quadrozzi Odena ,  Sharan Ajit Narang ,  Guy Gur-Ari Krakover ,  Aakanksha Chowdhery ,  David Martin Dohan ,  Aitor Lewkowycz ,  Jacob Austin ,  Henryk Michalewski ,  David Luan ,  David J. Bieber ,  Anders Johan Andreassen ,  Maxwell Isaac Nye

IPC: G06N5/022

Abstract: An example technique for image analysis is provided. An example image analysis method includes obtaining an instructive sequence descriptive of an instructive query, an instructive response, and an instructive trace of intermediate states from the instructive query to the instructive response. The example image analysis method includes inputting, to a machine-learned model, the instructive sequence and an operative image processing query that comprises image data, wherein the machine-learned model is configured to process the operative query with attention over the instructive sequence. The example method can include generating, using the machine-learned model and responsive to the operative query, an operative image processing response that comprises an analysis of the image data.

公开(公告)号：US20240386202A1

公开(公告)日：2024-11-21

申请号：US18653146

申请日：2024-05-02

Applicant: Google LLC

Inventor： Matthew Douglas Hoffman ,  Charles Aloysius Sutton ,  David Martin Dohan ,  Sholto Francis Alexandre Douglas ,  Tuan Anh Le ,  Van Du Phan ,  Aaron Thomas Parisi ,  Ryan Michael Rifkin ,  Pavel Sountsov ,  Sharad Vikram

IPC: G06F40/284

Abstract: Systems and methods for generative language model tuning can include training the generative language model to generate sets of output text tokens with set of intermediary text tokens with training examples that include input and output pairs. The training can include processing the input with the language model to determine a predicted output and a predicted set of intermediary text tokens. The predicted set of intermediary text tokens can then be evaluated based at least in part on the output associated with the input and the predicted output.

公开(公告)号：US20230394328A1

公开(公告)日：2023-12-07

申请号：US17881746

申请日：2022-08-05

Applicant: Google LLC

Inventor： Jason Weng Wei ,  Dengyong Zhou ,  Dale Eric Schuurmans ,  Quoc V. Le ,  Maarten Paul Bosma ,  Ed Huai-Hsin Chi ,  Olivier Jean Andrè Bousquet ,  Le Hou ,  Nathan Kemp Sekiguchi Scales ,  David J. Bieber ,  Charles Aloysius Sutton ,  Nathanael Martin Schärli ,  Augustus Quadrozzi Odena ,  Sharan Ajit Narang ,  Guy Gur-Ari Krakover ,  Aakanksha Chowdhery ,  Aitor Lewkowycz ,  Jiageng Luan ,  David Martin Dohan ,  Henryk Michalewski ,  Jacob Austin ,  Anders Johan Andreassen ,  Maxwell Isaac Nye ,  Xuezhi Wang

IPC: G06N5/02

CPC classification number: G06N5/022

Abstract: Example embodiments of aspects of the present disclosure provide an example computer-implemented method for improved prompting of a machine-learned model. The example method can include obtaining an instructive sequence descriptive of an instructive query, an instructive response, and an instructive trace of intermediate states from the instructive query to the instructive response. The example method can include inputting, to a machine-learned model, the instructive sequence and an operative query, wherein the machine-learned model is configured to process the operative query with attention over the instructive sequence. The example method can include generating, using the machine-learned model and responsive to the operative query, an operative response.

公开(公告)号：US20230244938A1

公开(公告)日：2023-08-03

申请号：US18160776

申请日：2023-01-27

Applicant: Google LLC

Inventor： Jason Weng Wei ,  Dengyong Zhou ,  Xuezhi Wang ,  Dale Eric Schuurmans ,  Quoc V. Le ,  Maarten Paul Bosma ,  Ed Huai-Hsin Chi ,  Olivier Jean Andrè Bousquet ,  Le Hou ,  Charles Aloysius Sutton ,  Nathanael Martin Schärli ,  Nathan Kemp Sekiguchi Scales ,  Augustus Quadrozzi Odena ,  Sharan Ajit Narang ,  Guy Gur-Ari Krakover ,  Aakanksha Chowdhery ,  David Martin Dohan ,  Aitor Lewkowycz ,  Henryk Michalewski ,  Jiageng Luan ,  David J. Bieber ,  Jacob Austin ,  Anders Johan Andreassen ,  Maxwell Isaac Nye ,  Yi Tay ,  Mostafa Dehghani

IPC: G06N3/08

CPC classification number: G06N3/08

Abstract: An example method for pretraining a machine-learned model is provided. The example method includes obtaining a plurality of different combinations of configuration parameters of a pretraining objective framework. The example method includes generating, using the pretraining objective framework, a plurality of corrupted training examples from one or more training examples, wherein the plurality of corrupted training examples are respectively generated according to the plurality of different combinations. The example method includes inputting the plurality of corrupted training examples into the machine-learned model, wherein the machine-learned model is configured to generate uncorrupted subportions corresponding to corrupted subportions of the corrupted training examples. The example method includes obtaining, from the machine-learned model, a plurality of outputs respectively generated by the machine-learned model based on the plurality of corrupted training examples. The example method includes updating one or more parameters of the machine-learned model based on an evaluation of the plurality of outputs.

公开(公告)号：US20210248492A1

公开(公告)日：2021-08-12

申请号：US17170305

申请日：2021-02-08

Applicant: Google LLC

Inventor： Augustus Quadrozzi Odena ,  Charles Aloysius Sutton

IPC: G06N5/04 ,  G06N20/00

Abstract: Generally, the present disclosure is directed to the generation and use of property signatures for computer programs. In particular, property signatures can serve as a representation for programs and program specifications meant for consumption by machine learning algorithms. Given a function with input type τin and output type τout, a property can be a function of type: (τin, τout)→Bool that (e.g., informally) describes some simple property of the function under consideration. For instance, if τin and τout are both lists of the same type, one property might ask ‘is the input list the same length as the output list?’.