公开(公告)号：US10313262B1

公开(公告)日：2019-06-04

申请号：US15385178

申请日：2016-12-20

Applicant: Amazon Technologies, Inc.

Inventor： Alexandra Juliet Brasch ,  Brent Russell Smith ,  Douglas R. Hains ,  Corry Lee-Boehm

IPC: G06F15/173 ,  H04L12/911 ,  H04L29/08 ,  H04L29/06

Abstract: Systems are provided to analyze user behavior with respect to different versions of content, and to identify the behavioral effects that can be attributed to the differences between the versions of content. Systems can determine whether an observed difference in user interactions with different versions of content is caused by the specific changes that have been made to content (e.g., an actual improvement or other substantive change), or whether the observed difference in user interactions is caused by the mere fact that the versions of content are different (e.g., due to the novelty of seeing a different version of content for the first time, regardless of whether the difference is a substantive improvement). In some cases, the observed effect may be caused both by the novelty of the content being changed and by the substance of the changes.