公开(公告)号：US09854029B1

公开(公告)日：2017-12-26

申请号：US14533023

申请日：2014-11-04

Applicant: AMAZON TECHNOLOGIES, INC.

Inventor： Sebastian Kohlmeier ,  Rusli Ciandy ,  Rui Chen ,  Sameer Rajendra Rajyaguru

IPC: H04L29/08 ,  H04L29/06

CPC classification number: H04L67/10 ,  G06Q30/02 ,  H04L43/00 ,  H04L67/22 ,  H04L67/42

Abstract: Described are techniques for performing statistical hypothesis experiments and determining user responses that do not match an assigned treatment. One of multiple experiment states may be assigned to a set of client devices. Response data that includes indications of the experiment state that was executed may be compared to the assigned experiment state to determine allocation matches and allocation mismatches. The allocation mismatches may be separated based on the assigned and executed experiment states to determine mismatches caused by preexisting content stored on a client device and mismatches caused by other experiment parameters.

公开(公告)号：US10936955B1

公开(公告)日：2021-03-02

申请号：US15406282

申请日：2017-01-13

Applicant: Amazon Technologies, Inc.

Inventor： Pramod Muralidharan ,  Ray Chen ,  Donald Kane ,  Vignesh Kannappan ,  Hancao Li ,  Ajay Kant Singh ,  Robert Andrew Kreek ,  Richard Bargreen ,  Rui Chen ,  Michael Luis Collado ,  Kevin Donald Kelly ,  Shen Li ,  Sameer Rajendra Rajyaguru ,  Serguei B. Stepaniants ,  Murali Brahmadesam

IPC: G06N5/02

Abstract: Technologies are disclosed for determining network-accessible content changes based on computed models and providing a long term forecast of user interaction at a network accessible site based upon a short term experiment at the site. A forecast model for a period of time is generated based upon historical data of user interactions at the site. An experiment is run for a short term at the site based upon a potential change at the site. Based upon data obtained during the experiment, scores are generated for a control group (no change) and a treatment group (potential change) and compared. If there are statistically significant differences between the control group and the treatment group scores, the long term forecast may be used to forecast what the long term impact of the experiment would be based upon the short term experiment.