公开(公告)号：US12259950B2

公开(公告)日：2025-03-25

申请号：US17063606

申请日：2020-10-05

Applicant: Spotify AB

Inventor： Zhenwen Dai ,  Praveen Chandar Ravichandran ,  Ghazal Fazelnia ,  Benjamin Carterette ,  Mounia Lalmas-Roelleke

IPC: G06N20/00 ,  G06F18/20 ,  G06F18/21 ,  G06F18/2113 ,  G06N7/01

Abstract: Disclosed examples include an automated online experimentation mechanism that can perform model selection from a large pool of models with a relatively small number of online experiments. The probability distribution of the metric of interest that contains the model uncertainty is derived from a Bayesian surrogate model trained using historical logs. Disclosed techniques can be applied to identify a superior model by sequentially selecting and deploying a list of models from the candidate set that balance exploration-exploitation.