公开(公告)号：US20180018580A1

公开(公告)日：2018-01-18

申请号：US15212037

申请日：2016-07-15

Applicant: Google Inc.

Inventor： Benjamin Kenneth Coppin ,  Mustafa Suleyman ,  Thomas Chadwick Walters ,  Timothy Mann ,  Chia-Yueh Carlton Chu ,  Martin Szummer ,  Luis Carlos Cobo Rus ,  Jean-Francois Crespo

IPC: G06N99/00 ,  G06F17/30 ,  G06N7/00

CPC classification number: G06N20/00 ,  G06F16/24578 ,  G06F16/9535 ,  G06N3/0445 ,  G06N3/084 ,  G06N7/005

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for using a machine learning model that has been trained through reinforcement learning to select a content item. One of the methods includes receiving first data characterizing a first context in which a first content item may be presented to a first user in a presentation environment; and providing the first data as input to a long-term engagement machine learning model, the model having been trained through reinforcement learning to: receive a plurality of inputs, and process each of the plurality of inputs to generate a respective engagement score for each input that represents a predicted, time-adjusted total number of selections by the respective user of future content items presented to the respective user in the presentation environment if the respective content item is presented in the respective context.