公开(公告)号：US20230350651A1

公开(公告)日：2023-11-02

申请号：US18348191

申请日：2023-07-06

Applicant: Google LLC

Inventor： Zifeng Huang ,  Yang Li ,  Xin Zhou ,  Gang Li ,  John Francis Canny

IPC: G06F8/38 ,  G06F40/40 ,  G06F8/33 ,  G06N3/0455 ,  G06F3/0484

CPC classification number: G06F8/38 ,  G06F40/40 ,  G06F8/33 ,  G06N3/0455 ,  G06F3/0484

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for training and using machine learning models to generate graphical user interfaces from textual descriptions.

公开(公告)号：US20230112710A1

公开(公告)日：2023-04-13

申请号：US18046428

申请日：2022-10-13

Applicant: Google LLC

Inventor： Zifeng Huang ,  Yang Li ,  Xin Zhou ,  Gang Li ,  John Francis Canny

IPC: G06F8/38 ,  G06F8/33 ,  G06F40/40

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for training and using machine learning models to generate graphical user interfaces from textual descriptions.

公开(公告)号：US12242824B2

公开(公告)日：2025-03-04

申请号：US18046446

申请日：2022-10-13

Applicant: Google LLC

Inventor： Zifeng Huang ,  Yang Li ,  Gang Li ,  Xin Zhou ,  John Francis Canny

IPC: G06F17/00 ,  G06F3/0484 ,  G06F8/33 ,  G06F8/38 ,  G06F40/40 ,  G06N3/0455

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for training and using machine learning models to generate graphical user interfaces from textual descriptions.

公开(公告)号：US20230115185A1

公开(公告)日：2023-04-13

申请号：US18046446

申请日：2022-10-13

Applicant: Google LLC

Inventor： Zifeng Huang ,  Yang Li ,  Gang Li ,  Xin Zhou ,  John Francis Canny

IPC: G06F3/0484 ,  G06N3/0455 ,  G06F40/40

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for training and using machine learning models to generate graphical user interfaces from textual descriptions.

公开(公告)号：US11740879B2

公开(公告)日：2023-08-29

申请号：US18046428

申请日：2022-10-13

Applicant: Google LLC

Inventor： Zifeng Huang ,  Yang Li ,  Xin Zhou ,  Gang Li ,  John Francis Canny

IPC: G06F17/00 ,  G06F8/38 ,  G06F40/40 ,  G06F8/33 ,  G06N3/0455 ,  G06F3/0484

CPC classification number: G06F8/38 ,  G06F3/0484 ,  G06F8/33 ,  G06F40/40 ,  G06N3/0455

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for training and using machine learning models to generate graphical user interfaces from textual descriptions.

公开(公告)号：US20230031702A1

公开(公告)日：2023-02-02

申请号：US17812208

申请日：2022-07-13

Applicant: Google LLC

Inventor： Yang Li ,  Xin Zhou ,  Gang Li ,  Mostafa Dehghani ,  Alexey Alexeevich Gritsenko

IPC: G06V10/82 ,  G06F3/16 ,  G06F40/284

Abstract: A method includes receiving, via a computing device, a screenshot of a display provided by a graphical user interface of the computing device. The method also includes generating, by an image-structure transformer of a neural network, a representation by fusing a first embedding based on the screenshot and a second embedding based on a layout of virtual objects in the screenshot. The method additionally includes predicting, by the neural network and based on the generated representation, a modeling task output associated with the graphical user interface. The method further includes providing, by the computing device, the predicted modeling task output.