公开(公告)号：US12032658B2

公开(公告)日：2024-07-09

申请号：US17055313

申请日：2018-11-20

Applicant: GOOGLE LLC

Inventor： Atilla Kiraly ,  Shravya Shetty ,  Sujeeth Bharadwaj ,  Diego Ardila ,  Bokyung Choi

IPC: G06T7/11 ,  G06F18/213 ,  G06F18/2415 ,  G06F18/25 ,  G06N3/04 ,  G06N3/08 ,  G06N20/20 ,  G06T7/00 ,  G06T7/73 ,  G16H50/20

CPC classification number: G06F18/254 ,  G06F18/213 ,  G06F18/2415 ,  G06N3/04 ,  G06N3/08 ,  G06N20/20 ,  G06T7/0012 ,  G06T7/11 ,  G06T7/73 ,  G16H50/20 ,  G06T2207/10081 ,  G06T2207/20076 ,  G06T2207/20081 ,  G06T2207/20084 ,  G06T2207/20132 ,  G06T2207/30061 ,  G06T2207/30096 ,  G06V2201/031

Abstract: A method and system to generate a probabilistic prediction of the presence/absence of cancer in longitudinal and current image datasets, and/or multimodal image datasets, and the location of the cancer, is described. The method and system uses an ensemble of deep learning models. The ensemble includes a global model in the form of a 3D convolutional neural network (CNN) extracting features in the datasets indicative of the presence of cancer on a global basis. The ensemble also includes a two-stage prediction model which includes a first stage or detection model which identifies cancer detection candidates (different cropped volumes of 3D data in the a dataset containing candidates which may be cancer) and a second stage or probability model which incorporates the longitudinal datasets (or multimodal images in a multimodal dataset) and the extracted features from the global model and assigns a cancer probability p to each of the cancer detection candidates. An overall prediction of probability of cancer is obtained from the probabilities assigned by the second stage model, e.g., using a Noisy-OR approach.