公开(公告)号：US09854029B1

公开(公告)日：2017-12-26

申请号：US14533023

申请日：2014-11-04

Applicant: AMAZON TECHNOLOGIES, INC.

Inventor： Sebastian Kohlmeier ,  Rusli Ciandy ,  Rui Chen ,  Sameer Rajendra Rajyaguru

IPC: H04L29/08 ,  H04L29/06

CPC classification number: H04L67/10 ,  G06Q30/02 ,  H04L43/00 ,  H04L67/22 ,  H04L67/42

Abstract: Described are techniques for performing statistical hypothesis experiments and determining user responses that do not match an assigned treatment. One of multiple experiment states may be assigned to a set of client devices. Response data that includes indications of the experiment state that was executed may be compared to the assigned experiment state to determine allocation matches and allocation mismatches. The allocation mismatches may be separated based on the assigned and executed experiment states to determine mismatches caused by preexisting content stored on a client device and mismatches caused by other experiment parameters.