公开(公告)号：US20240070692A1

公开(公告)日：2024-02-29

申请号：US17822979

申请日：2022-08-29

Applicant: COUPANG CORP.

Inventor： Xiaowei GONG ,  Ngoc-Lan Isabelle PHAN ,  Xianbing LING ,  Aldi TJAHJADI

IPC: H04L41/5061 ,  H04L43/0852

CPC classification number: H04L41/5064 ,  H04L43/0852

Abstract: The embodiments of the present disclosure provide systems and methods for optimizing calculations of latency metrics for user experiments, comprising receiving from a user device over a network, experiment parameters related to a first experiment of a set of experiments, the set of experiments comprising at least one of a treatment group and at least one of a control group. The experiment parameters are associated with at least one webpage. The user device receives over a network time till interaction (TTI) data for the first experiment, wherein the TTI data comprises a time value and a unique identifier. TTI is calculated for each treatment group experiment and for each control group experiment. If the treatment group experiment value is greater than the predetermined threshold value, the systems and methods send a notification informing users or disable activation of the treatment group experiment.

公开(公告)号：US20220067762A1

公开(公告)日：2022-03-03

申请号：US17003705

申请日：2020-08-26

Applicant: Coupang Corp.

Inventor： Xiaowei GONG ,  Beibei Ye ,  Jun Ye ,  Chul Seo

IPC: G06Q30/02 ,  G06F17/18

Abstract: Computer-implemented systems and methods for predicting an optimal stop point during an experiment test are disclosed. A disclosed computer-implemented system comprises a memory storing instructions and at least one or more processors. The at least one or more processors may be configured to execute the instructions to obtain a total test time, obtain a minimum detectable effect trend data, determine an average minimum detectable effect change, determine a minimum detectable effect cumulative change threshold, determine a plurality of instantaneous minimum detectable effect changes, and determine a plurality of cumulative minimum detectable effect changes. Furthermore, the at least one or more processors may be configured to determine an optimal stop point time based on the average minimum detectable effect change, the plurality of instantaneous minimum detectable effect changes, and the minimum detectable effect cumulative change threshold to provide the optimal stop point time to a server to conclude the active test.

公开(公告)号：US20220067754A1

公开(公告)日：2022-03-03

申请号：US17005232

申请日：2020-08-27

Applicant: COUPANG CORP.

Inventor： Xiaowei GONG ,  Beibei YE ,  Jun YE ,  Chul SEO

IPC: G06Q30/02 ,  G06F16/955 ,  G06F16/958

Abstract: Embodiments of the present disclosure include computer-implemented systems and methods for predicting a minimum detectable effect. The system may include at least one processor configured to execute instructions to perform steps. The steps may include sending a first webpage to a first user device and a second webpage to a second user device. The second webpage may include at least one characteristic different than the first website. The steps may include collecting user interaction data from the first and second user devices and determining a current minimum detectable effect of a user experience. The steps may include retrieving a set of historic minimum detectable effect values associated with an earlier period of time and determining a percentile rank of the current minimum detectable effect based on the retrieved set of historic minimum detectable effect values. The steps may include predicting a first and second future value of the minimum detectable effect of the user experience and aggregating the first and second future values. The aggregated first and second future value may be compared with a threshold to determine whether or not to stop an experiment and implement a change on a website.