公开(公告)号：US20240119586A1

公开(公告)日：2024-04-11

申请号：US17768419

申请日：2020-10-13

Applicant: Google LLC

Inventor： Vivek Natarajan ,  Yuan Liu ,  David Coz ,  Amirata Ghorbani

IPC: G06T7/00 ,  G06T11/00 ,  G16H10/60 ,  G16H50/70

CPC classification number: G06T7/0012 ,  G06T11/001 ,  G16H10/60 ,  G16H50/70 ,  G06T2207/20081 ,  G06T2207/20084 ,  G06T2207/20104 ,  G06T2207/30088 ,  G06T2207/30096

Abstract: We disclose the generation and training of Generative Adversarial Networks (GAN) to synthesize clinical images with skin conditions. Synthetic images for a pre-specified skin condition are generated, while being able to vary its size, location and the underlying skin color. We demonstrate that the generated images are of high fidelity using objective GAN evaluation metrics. The synthetic images are not only visually similar to real images, but also embody the respective skin conditions. Additionally, synthetic skin images can be used as a data augmentation technique for training a skin condition classifier, and improve the ability of the classifier to detect rare but malignant conditions.

公开(公告)号：US12272442B2

公开(公告)日：2025-04-08

申请号：US17551050

申请日：2021-12-14

Applicant: Google LLC

Inventor： Xiaohua Zhai ,  Sylvain Gelly ,  Alexander Kolesnikov ,  Yin Ching Jessica Yung ,  Joan Puigcerver i Perez ,  Lucas Klaus Beyer ,  Neil Matthew Tinmouth Houlsby ,  Wen Yau Aaron Loh ,  Alan Prasana Karthikesalingam ,  Basil Mustafa ,  Jan Freyberg ,  Patricia Leigh MacWilliams ,  Vivek Natarajan

IPC: G16H30/40 ,  G06N3/02 ,  G06N3/096 ,  G06T3/4053 ,  G06T7/00 ,  G06V10/82 ,  G16H50/20

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for training a neural network to perform a downstream computer vision task. One of the methods includes pre-training an initial neural network that shares layers with the neural network to perform an initial computer vision task and then training the neural network on the downstream computer vision task.

公开(公告)号：US20240428937A1

公开(公告)日：2024-12-26

申请号：US18338003

申请日：2023-06-20

Applicant: Google LLC

Inventor： Vivek Natarajan ,  Karan Singhal ,  Shekoofeh Azizi ,  Alan Prasana Karthikesalingam ,  Tao Tu ,  Seyedeh Sara Mahdavi ,  Christopher Semturs

IPC: G16H50/20

Abstract: An aspect of the present disclosure provides an example method comprising: receiving an input query associated with a particular task domain of a plurality of available task domains; obtaining a machine-learned prompt component and a curated prompt component, wherein the machine-learned prompt component comprises a plurality of machine-learned prompt values for the plurality of available task domains, and wherein the curated prompt component comprises a plurality of exemplar prompt values corresponding to one or more embedded natural language exemplars for the particular task domain from domain experts; and generating an output responsive to the input query by processing a combined prompt and the input query using a pre-trained machine-learned model, wherein the combined prompt comprises the machine-learned prompt component and the curated prompt component.

公开(公告)号：US20230260652A1

公开(公告)日：2023-08-17

申请号：US18012187

申请日：2021-12-10

Applicant: Google LLC

Inventor： Shekoofeh Azizi ,  Wen Yau Aaron Loh ,  Zachary William Beaver ,  Ting Chen ,  Jonathan Paul Deaton ,  Jan Freyberg ,  Alan Prasana Karthikesalingam ,  Simon Kornblith ,  Basil Mustafa ,  Mohammad Norouzi ,  Vivek Natarajan ,  Fiona Keleher Ryan

IPC: G16H50/20 ,  G06T7/00 ,  G06V10/74 ,  G16H30/40 ,  G16H50/70

CPC classification number: G16H50/20 ,  G06T7/0012 ,  G06V10/761 ,  G16H30/40 ,  G16H50/70 ,  G06T2207/20081 ,  G06T2207/20132

Abstract: Systems and methods can perform self-supervised machine learning for improved medical image analysis. As one example, self-supervised learning on ImageNet, followed by additional self-supervised learning on unlabeled medical images from the target domain of interest, followed by fine-tuning on labeled medical images from the target domain significantly improves the accuracy of medical image classifiers such as, for example diagnostic models. Another example aspect of the present disclosure is directed to a novel Multi-Instance Contrastive Learning (MICLe) method that uses multiple different medical images that share one or more attributes (e.g., multiple images that depict the same underlying pathology and/or the same patient) to construct more informative positive pairs for self-supervised learning.

公开(公告)号：US20220189612A1

公开(公告)日：2022-06-16

申请号：US17551050

申请日：2021-12-14

Applicant: Google LLC

Inventor： Xiaohua Zhai ,  Sylvain Gelly ,  Alexander Kolesnikov ,  Yin Ching Jessica Yung ,  Joan Puigcerver i Perez ,  Lucas Klaus Beyer ,  Neil Matthew Tinmouth Houlsby ,  Wen Yau Aaron Loh ,  Alan Prasana Karthikesalingam ,  Basil Mustafa ,  Jan Freyberg ,  Patricia Leigh MacWilliams ,  Vivek Natarajan

IPC: G16H30/40 ,  G16H50/20 ,  G06T7/00 ,  G06T3/40 ,  G06N3/02

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for training a neural network to perform a downstream computer vision task. One of the methods includes pre-training an initial neural network that shares layers with the neural network to perform an initial computer vision task and then training the neural network on the downstream computer vision task.