公开(公告)号：US20220114079A1

公开(公告)日：2022-04-14

申请号：US17232229

申请日：2021-04-16

Applicant: Coupang Corp.

Inventor： Ngoc-Lan Isabelle Phan ,  Beibei Ye ,  Chul Seo

IPC: G06F11/36

Abstract: Disclosed herein are systems and methods for a system for distributing user requests. The system may comprise a memory storing instructions and at least one processor configured to execute instructions to perform operations. These operations may comprise receiving from a local network device, without requesting, a data randomization scheme determining a test dataset from among a plurality of test datasets for deployment at a client device; based on the received data randomization scheme, determining test participation data for transmitting to a plurality of client devices; transmitting the test participation data to the plurality of client devices; transmitting, to the plurality of client devices, datasets configured for deployment by the plurality of client devices according to the test participation data; and receiving, from at least one of the plurality of client devices, interaction data associated with one of the datasets deployed by the at least one client device according to the test participation data.

公开(公告)号：US11797423B2

公开(公告)日：2023-10-24

申请号：US17380152

申请日：2021-07-20

Applicant: COUPANG CORP.

Inventor： Ngoc-Lan Isabelle Phan ,  Jun Ye ,  Beibei Ye ,  Chul Seo

IPC: G06F11/00 ,  G06F11/36 ,  G06Q30/0201 ,  G06F16/248 ,  G06F16/245

CPC classification number: G06F11/3672 ,  G06F11/3664 ,  G06F11/3684 ,  G06F11/3688 ,  G06F16/245 ,  G06F16/248 ,  G06Q30/0201

Abstract: A computerized method for controlled testing, comprising: providing a design specification for event data, the design specification including at least one of an event data source, an event data filter, and an event format; retrieving testing metrics; configuring testing events based on the design specification, by: retrieving testing events from the event data source specified in the design specification; filtering the retrieved testing events based in the design specification; and formatting the filtered testing events based on the design specification; generating analysis data by applying testing metrics to the configured event data; generating output data based on testing rules; and generating a user interface to display the output data.

公开(公告)号：US11232018B1

公开(公告)日：2022-01-25

申请号：US17005834

申请日：2020-08-28

Applicant: COUPANG CORP.

Inventor： Ngoc-Lan Isabelle Phan ,  Jun Ye ,  Beibei Ye ,  Chul Seo

IPC: G06F11/00 ,  G06F11/36 ,  G06Q30/02 ,  G06F16/248 ,  G06F16/245

Abstract: A computerized method for controlled testing, comprising: providing a design specification for event data, the design specification including at least one of an event data source, an event data filter, and an event format; retrieving testing metrics; configuring testing events based on the design specification, by: retrieving testing events from the event data source specified in the design specification; filtering the retrieved testing events based in the design specification; and formatting the filtered testing events based on the design specification; generating analysis data by applying testing metrics to the configured event data; generating output data based on testing rules; and generating a user interface to display the output data.

公开(公告)号：US11909655B1

公开(公告)日：2024-02-20

申请号：US17883922

申请日：2022-08-09

Applicant: COUPANG CORP.

Inventor： Aldi Tjahjadi ,  ZhaoPing Yan ,  Ngoc-Lan Isabelle Phan ,  Jean-Baptiste Rieu

IPC: H04L47/2475 ,  H04L47/62

CPC classification number: H04L47/2475 ,  H04L47/6215

Abstract: Computer-implemented systems and methods for selective deployment of experimental configurations are disclosed The systems and methods may include performing steps of deploying a webpage comprising a plurality of configurations, wherein the plurality of configurations exhibit different behaviors; configuring a traffic container comprising a first bucket and a second bucket based on user input; assigning one or more experiments to the traffic container based on the user input, wherein the one or more experiments determine appropriate configurations for the first bucket and the second bucket; accepting incoming traffic for accessing the webpage; randomly assigning a first subset of the incoming traffic to the first bucket and a second subset of the incoming traffic to the second bucket; transmitting the webpage in appropriate configurations based on the random assignments; and obtaining one or more measurements indicative of relative performances of the appropriate configurations.

公开(公告)号：US20220066913A1

公开(公告)日：2022-03-03

申请号：US17380152

申请日：2021-07-20

Applicant: Coupang Corp.

Inventor： Ngoc-Lan Isabelle Phan ,  Jun Ye ,  Beibel Ye ,  Chul Seo

IPC: G06F11/36 ,  G06Q30/02 ,  G06F16/248 ,  G06F16/245

Abstract: A computerized method for controlled testing, comprising: providing a design specification for event data, the design specification including at least one of an event data source, an event data filter, and an event format; retrieving testing metrics; configuring testing events based on the design specification, by: retrieving testing events from the event data source specified in the design specification; filtering the retrieved testing events based in the design specification; and formatting the filtered testing events based on the design specification; generating analysis data by applying testing metrics to the configured event data; generating output data based on testing rules; and generating a user interface to display the output data.

公开(公告)号：US11620210B2

公开(公告)日：2023-04-04

申请号：US17232229

申请日：2021-04-16

Applicant: Coupang Corp.

Inventor： Ngoc-Lan Isabelle Phan ,  Beibei Ye ,  Chul Seo

IPC: G06F11/00 ,  G06F11/36

Abstract: Disclosed herein are systems and methods for a system for distributing user requests. The system may comprise a memory storing instructions and at least one processor configured to execute instructions to perform operations. These operations may comprise receiving from a local network device, without requesting, a data randomization scheme determining a test dataset from among a plurality of test datasets for deployment at a client device; based on the received data randomization scheme, determining test participation data for transmitting to a plurality of client devices; transmitting the test participation data to the plurality of client devices; transmitting, to the plurality of client devices, datasets configured for deployment by the plurality of client devices according to the test participation data; and receiving, from at least one of the plurality of client devices, interaction data associated with one of the datasets deployed by the at least one client device according to the test participation data.

公开(公告)号：US11010281B1

公开(公告)日：2021-05-18

申请号：US17068529

申请日：2020-10-12

Applicant: Coupang Corp.

Inventor： Ngoc-Lan Isabelle Phan ,  Beibei Ye ,  Chul Seo

IPC: G06F11/00 ,  G06F11/36

Abstract: Disclosed herein are systems and methods for a system for distributing user requests. The system may comprise a memory storing instructions and at least one processor configured to execute instructions to perform operations. These operations may comprise receiving from a local network device, without requesting, a data randomization scheme determining a test dataset from among a plurality of test datasets for deployment at a client device; based on the received data randomization scheme, determining test participation data for transmitting to a plurality of client devices; transmitting the test participation data to the plurality of client devices; transmitting, to the plurality of client devices, datasets configured for deployment by the plurality of client devices according to the test participation data; and receiving, from at least one of the plurality of client devices, interaction data associated with one of the datasets deployed by the at least one client device according to the test participation data.