公开(公告)号：US20240403713A1

公开(公告)日：2024-12-05

申请号：US18679215

申请日：2024-05-30

Applicant: Netflix, Inc.

Inventor： Ding Tong ,  Qifeng Qiao ,  Justin Derrick Basilico ,  Ting-Po Lee ,  James McInerney

IPC: G06N20/00

Abstract: A computer-implemented method includes identifying offline evaluation metrics that indicate, for a given feedback loop in a recommendation system, various feedback loop characteristics that are detrimental to the feedback loop. The method also includes generating a predictive machine learning (ML) model that correlates the identified offline evaluation metrics with indications of those feedback loop characteristics that are detrimental to the feedback loop. The method further includes instantiating the predictive ML model to predict, using the correlated offline evaluation metrics and the detrimental feedback loop characteristics, how the feedback loop will be negatively affected over time, and providing, to at least one entity, an indication of how the feedback loop will be negatively affected over time due to the detrimental feedback loop characteristics. Various other methods, systems, and computer-readable media are also disclosed.