-
公开(公告)号:US12165032B2
公开(公告)日:2024-12-10
申请号:US16586813
申请日:2019-09-27
Applicant: Google LLC
Inventor: Yang Li , Lukasz Mieczyslaw Kaiser , Samuel Bengio , Si Si
IPC: G06N3/045 , G06F16/903 , G06N3/10 , G06F16/00 , G06F40/00
Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for implementing an area attention layer in a neural network system. The area attention layer area implements a way for a neural network model to attend to areas in the memory, where each area contains a group of items that are structurally adjacent.
-
公开(公告)号:US20230112710A1
公开(公告)日:2023-04-13
申请号:US18046428
申请日:2022-10-13
Applicant: Google LLC
Inventor: Zifeng Huang , Yang Li , Xin Zhou , Gang Li , John Francis Canny
Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for training and using machine learning models to generate graphical user interfaces from textual descriptions.
-
公开(公告)号:US11740879B2
公开(公告)日:2023-08-29
申请号:US18046428
申请日:2022-10-13
Applicant: Google LLC
Inventor: Zifeng Huang , Yang Li , Xin Zhou , Gang Li , John Francis Canny
IPC: G06F17/00 , G06F8/38 , G06F40/40 , G06F8/33 , G06N3/0455 , G06F3/0484
CPC classification number: G06F8/38 , G06F3/0484 , G06F8/33 , G06F40/40 , G06N3/0455
Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for training and using machine learning models to generate graphical user interfaces from textual descriptions.
-
公开(公告)号:US20230031702A1
公开(公告)日:2023-02-02
申请号:US17812208
申请日:2022-07-13
Applicant: Google LLC
Inventor: Yang Li , Xin Zhou , Gang Li , Mostafa Dehghani , Alexey Alexeevich Gritsenko
IPC: G06V10/82 , G06F3/16 , G06F40/284
Abstract: A method includes receiving, via a computing device, a screenshot of a display provided by a graphical user interface of the computing device. The method also includes generating, by an image-structure transformer of a neural network, a representation by fusing a first embedding based on the screenshot and a second embedding based on a layout of virtual objects in the screenshot. The method additionally includes predicting, by the neural network and based on the generated representation, a modeling task output associated with the graphical user interface. The method further includes providing, by the computing device, the predicted modeling task output.
-
公开(公告)号:US20200104686A1
公开(公告)日:2020-04-02
申请号:US16586702
申请日:2019-09-27
Applicant: Google LLC
Inventor: Yang Li , Sanjiv Kumar , Pei-Hung Chen , Si Si , Cho-Jui Hsieh
Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for decreasing neural network inference times using softmax approximation. One of the methods includes maintaining data specifying a respective softmax weight vector for each output in a vocabulary of possible neural network outputs; receiving a neural network input; processing the neural network input using one or more initial neural network layers to generate a context vector for the neural network input; and generating an approximate score distribution over the vocabulary of possible neural network outputs for the neural network input, comprising: processing the context vector using a screening model configured to predict a proper subset of the vocabulary for the context input; and generating a respective logit for each output that is in the proper subset, comprising applying the softmax weight vector for the output to the context vector.
-
公开(公告)号:US20230350651A1
公开(公告)日:2023-11-02
申请号:US18348191
申请日:2023-07-06
Applicant: Google LLC
Inventor: Zifeng Huang , Yang Li , Xin Zhou , Gang Li , John Francis Canny
IPC: G06F8/38 , G06F40/40 , G06F8/33 , G06N3/0455 , G06F3/0484
CPC classification number: G06F8/38 , G06F40/40 , G06F8/33 , G06N3/0455 , G06F3/0484
Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for training and using machine learning models to generate graphical user interfaces from textual descriptions.
-
公开(公告)号:US12242824B2
公开(公告)日:2025-03-04
申请号:US18046446
申请日:2022-10-13
Applicant: Google LLC
Inventor: Zifeng Huang , Yang Li , Gang Li , Xin Zhou , John Francis Canny
IPC: G06F17/00 , G06F3/0484 , G06F8/33 , G06F8/38 , G06F40/40 , G06N3/0455
Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for training and using machine learning models to generate graphical user interfaces from textual descriptions.
-
8.
公开(公告)号:US20230297580A1
公开(公告)日:2023-09-21
申请号:US17721873
申请日:2022-04-15
Applicant: Google LLC
Inventor: Sheng Li , Garrett Axel Andersen , Norman Paul Jouppi , Quoc V. Le , Liqun Cheng , Parthasarathy Ranganathan , Julian Paul Grady , Yang Li , Martin Wicke , Yifeng Lu , Yun Ni , Kun Wang
IPC: G06F16/2457 , G06F16/2455 , G06N3/063
CPC classification number: G06F16/2457 , G06F16/24554 , G06N3/063
Abstract: According to various implementations, generally disclosed herein is a hybrid and hierarchical neural architecture search (NAS) approach. The approach includes performing a search space partitioning scheme to divide the search space into sub-search spaces. The approach further includes performing a first type of NAS, such as a Multi-trial NAS, to cover a search across the sub-search spaces. The approach also includes performing a second type of NAS, such as a One-Shot NAS, to cover each sub-search space. The approach further includes automatically stopping the second type of NAS based on one or more early stopping criteria.
-
公开(公告)号:US20230115185A1
公开(公告)日:2023-04-13
申请号:US18046446
申请日:2022-10-13
Applicant: Google LLC
Inventor: Zifeng Huang , Yang Li , Gang Li , Xin Zhou , John Francis Canny
IPC: G06F3/0484 , G06N3/0455 , G06F40/40
Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for training and using machine learning models to generate graphical user interfaces from textual descriptions.
-
公开(公告)号:US20220004849A1
公开(公告)日:2022-01-06
申请号:US17295561
申请日:2019-11-20
Applicant: Google LLC
Inventor: Zhourong Chen , Yang Li , Samuel Bengio , Si Si
Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for processing images using neural networks. One of the methods includes receiving a network input; processing the network input through a gater neural network to generate a gating vector that includes a respective value for each of a plurality of filters; determining, from the gating vector and for each of the plurality of filters, whether the filter is active or inactive; and processing the network input through the main convolutional neural network to generate an image processing output, comprising, for each convolutional layer in the first plurality of convolutional layers: receiving an input feature map for the convolutional layer; and generating an output feature map, the generating comprising: for each filter of the convolutional layer that is inactive: setting the output channel for the filter to have all zero elements.
-
-
-
-
-
-
-
-
-