Abstract:
Sample delta monitoring is described herein. In one or more implementations, first and second experimental groups are defined in a randomized controlled trial. A first set of data indicative of a first experimental group in the randomized controlled trial is received. A second set of data indicative of a second experimental group in the randomized controlled trial is received. Based on sample counts of the first and second sets of data, an indication is generated that the experimental groups in the randomized controlled trial are skewed.
Abstract:
A system and method for generating a score for a listing are described. A data field of a listing is parsed and at least one element from the data field is generated. A score for the listing is calculated based on the at least one element, the listing score representing a probability of the listing being in one of two binary classifications. The listing score and one or more listing attribute values are inputted into a binary classifier. An output is generated using the binary classifier, the output representing a refined score for the listing based on the listing score and at least one of the listing attribute values.
Abstract:
An online experiment system is described that generates a randomization evaluation for an online experiment, while the experiment is ongoing, indicating whether a distribution of experiment participants allocated to one or more participant groups satisfies an expected distribution. The online experiment system analyzes one of the experiment groups to obtain an observed distribution of the subset of experiment participants included in the experiment group. The online experiment system then evaluates the observed distribution relative to the expected distribution for the experiment according to a decision criteria of a population stability index test. The decision criteria is influenced by a tuning parameter that represents a ratio of experiment participants included in the observed experiment group to experiment participants included in a different experiment group. Responsive to the randomization evaluation indicating that a current distribution of experiment participants fails to satisfy the expected distribution for the experiment, an alert is output.
Abstract:
In an example embodiment, a pseudo product group for an item to be listed in an online marketplace having unstructured data is determined. Then, a fair market price for the item is determined using past data from listings in the pseudo product group. The fair market price may be used as a reference price in a curve of price elasticity versus price to obtain a price elasticity value. A price range may then be recommended to a user for the listing based upon the fair market price and the price elasticity value.
Abstract:
Methods and systems for enhancing a user interface of a client device are described. In an example embodiment, a machine processes a query to identify one or more item listings that satisfy the query. Each item listing is associated with at least one item being offered for sale. The machine assigns one or more scores to one or more item listings that satisfy the query based on an observed demand metric derived from historical performance data of the one or more item listings. The machine causes a presentation of the one or more item listings that satisfy the query in a search results page displayed in the user interface of the client device. The one or more item listings are positioned in the search results page based on the one or more scores assigned to the one or more item listings.