公开(公告)号：US20210358579A1

公开(公告)日：2021-11-18

申请号：US16618656

申请日：2017-09-29

Applicant: Google LLC

Inventor： Kai Chen ,  Eyal Oren ,  Hector Yee ,  James Wilson ,  Alvin Rajkomar ,  Michaela Hardt

IPC: G16H10/60 ,  G06N20/00

Abstract: A method is described for training a predictive model which increases the interpretability and trustworthiness of the model for end-users. The model is trained from data having multitude of features. Each feature is associated with a real value and a time component. Many predicates (atomic elements for training the model) are defined as binary functions operating on the features, and typically time sequences of the features or logical combinations thereof. The predicates can be limited to those functions which have human understandability or encode expert knowledge relative to a predication task of the model. We iteratively train a boosting model with input from an operator or human-in-the-loop. The human-in-the-loop is provided with tools to inspect the model as it is iteratively built and remove one or more of the predicates in the model, e.g. if it does not have indicia of trustworthiness, is not causally related to a prediction of the model, or is not understandable. We repeat the iterative process several times ultimately generate a final boosting model. The final model is then evaluated, e.g., for accuracy, complexity, trustworthiness and post-hoc explainability.

公开(公告)号：US11935634B2

公开(公告)日：2024-03-19

申请号：US15690721

申请日：2017-08-30

Applicant: Google LLC

Inventor： Alexander Mossin ,  Alvin Rajkomar ,  Eyal Oren ,  James Wilson ,  James Wexler ,  Patrik Sundberg ,  Andrew Dai ,  Yingwei Cui ,  Gregory Corrado ,  Hector Yee ,  Jacob Marcus ,  Jeffrey Dean ,  Benjamin Irvine ,  Kai Chen ,  Kun Zhang ,  Michaela Hardt ,  Xiaomi Sun ,  Nissan Hajaj ,  Peter Junteng Liu ,  Quoc Le ,  Xiaobing Liu ,  Yi Zhang

IPC: G06N3/08 ,  G06N3/044 ,  G06N3/045 ,  G16H10/60 ,  G16H15/00 ,  G16H50/30 ,  G16H50/20

CPC classification number: G16H10/60 ,  G06N3/044 ,  G06N3/045 ,  G06N3/08 ,  G16H15/00 ,  G16H50/30 ,  G16H50/20

Abstract: A system for predicting and summarizing medical events from electronic health records includes a computer memory storing aggregated electronic health records from a multitude of patients of diverse age, health conditions, and demographics including medications, laboratory values, diagnoses, vital signs, and medical notes. The aggregated electronic health records are converted into a single standardized data structure format and ordered arrangement per patient, e.g., into a chronological order. A computer (or computer system) executes one or more deep learning models trained on the aggregated health records to predict one or more future clinical events and summarize pertinent past medical events related to the predicted events on an input electronic health record of a patient having the standardized data structure format and ordered into a chronological order. An electronic device configured with a healthcare provider-facing interface displays the predicted one or more future clinical events and the pertinent past medical events of the patient.

公开(公告)号：US11410756B2

公开(公告)日：2022-08-09

申请号：US15690714

申请日：2017-08-30

Applicant: Google LLC

Inventor： Eyal Oren ,  Yingwei Cui ,  Gerardo Flores ,  Gavin Duggan ,  Kun Zhang ,  Kurt Litsch ,  Patrik Sundberg ,  Yi Zhang

IPC: G16H50/30 ,  G16H50/20 ,  G16H10/60 ,  G06N3/08 ,  G16H15/00 ,  G06N3/04

Abstract: A system for predicting and summarizing medical events from electronic health records includes a computer memory storing aggregated electronic health records from a multitude of patients of diverse age, health conditions, and demographics including medications, laboratory values, diagnoses, vital signs, and medical notes. The aggregated electronic health records are converted into a single standardized data structure format and ordered arrangement per patient, e.g., into a chronological order. A computer (or computer system) executes one or more deep learning models trained on the aggregated health records to predict one or more future clinical events and summarize pertinent past medical events related to the predicted events on an input electronic health record of a patient having the standardized data structure format and ordered into a chronological order. An electronic device configured with a healthcare provider-facing interface displays the predicted one or more future clinical events and the pertinent past medical events of the patient.

公开(公告)号：US20190387277A1

公开(公告)日：2019-12-19

申请号：US16556004

申请日：2019-08-29

Applicant: Google LLC

Inventor： Eyal Oren ,  Farzan Rohani

IPC: H04N21/466 ,  G06Q30/02 ,  H04N21/25 ,  H04N21/2543 ,  H04N21/258 ,  H04N21/442 ,  H04N21/45 ,  H04N21/658

Abstract: The present disclosure provides systems and methods for estimating audience member engagement with content, or distinguishing between users consuming content and users who have become distracted or have left. User presence or attention may be estimated from user interactions with or skipping of content, with the user interactions either compared to high quality engagement data from small audience measurement panels, or extrapolated based on a temporal-engagement curve. An attention gap may be estimated, representing users that were not present for or not engaged with or paying attention to a presentation of content at a client device. This allows the measurement system to distinguish between users who consumed and potentially enjoyed the content, and users who did not, even as client devices of both sets of users receive and present the content items.

公开(公告)号：US12191007B2

公开(公告)日：2025-01-07

申请号：US16618656

申请日：2017-09-29

Applicant: Google LLC

Inventor： Kai Chen ,  Eyal Oren ,  Hector Yee ,  James Wilson ,  Alvin Rajkomar ,  Michaela Hardt

IPC: G16H10/60 ,  G06N20/00

Abstract: Example embodiments relate to a method for training a predictive model from data. The method includes defining a multitude of predicates as binary functions operating on time sequences of the features or logical operations on the time sequences of the features. The method also includes iteratively training a boosting model by generating a number of new random predicates, scoring all the new random predicates by weighted information gain with respect to a class label associated with a prediction of the boosting model, selecting a number of the new random predicates with the highest weighted information gain and adding them to the boosting model, computing weights for all the predicates in the boosting model, removing one or more of the selected new predicates with the highest information gain from the boosting model in response to input from an operator. The method may include repeating the prior steps a plurality of times.

公开(公告)号：US11089371B2

公开(公告)日：2021-08-10

申请号：US16556004

申请日：2019-08-29

Applicant: Google LLC

Inventor： Eyal Oren ,  Farzan Rohani

IPC: H04N21/466 ,  G06Q30/02 ,  H04N21/442 ,  H04N21/25 ,  H04N21/2543 ,  H04N21/658 ,  H04N21/258 ,  H04N21/45

Abstract: The present disclosure provides systems and methods for estimating audience member engagement with content, or distinguishing between users consuming content and users who have become distracted or have left. User presence or attention may be estimated from user interactions with or skipping of content, with the user interactions either compared to high quality engagement data from small audience measurement panels, or extrapolated based on a temporal-engagement curve. An attention gap may be estimated, representing users that were not present for or not engaged with or paying attention to a presentation of content at a client device. This allows the measurement system to distinguish between users who consumed and potentially enjoyed the content, and users who did not, even as client devices of both sets of users receive and present the content items.