Get Help From Experts in Data Science and Mathematics
ePortfolios |STEM Gender Equality | ZOOM | Slack | Spreading Mathematical Happiness

You can support MathsGee with your DONATION

0 like 0 dislike
31 views
When doing A\B experiments, how does the Uber experimentation platform recommendation engine work?
in Data Science by anonymous | 31 views

1 Answer

0 like 0 dislike
Best answer

To determine how correlated two metrics are to each other, they add their popularity and absolute scores, enabling them to better understand their relationship. The two basic approaches to calculating these scores are:

  • Popularity score: The more frequently two metrics are selected together across experiments, the higher the score assigned to their relationship. They use the Jaccard Index  to help users discover the most relevant metric once they select their initial metric. This score accounts for the experimenters’ metrics selection from past experiments.
  • Absolute score: Using their XP, they can generate a pool of user samples from their metrics and calculate the Pearson correlation score of the two metrics. This accounts for serendipitous discovery; namely, the experimenter may not have considered adding a metric to the experiment since it is not directly related, but it might be moving with the user-selected metric.

After calculating these two scores, they add the score of the two steps above with relative weights on each term and recommend the metrics with the highest score to the experimenter based on their first choice of metrics.  

by Wooden (1,460 points)

Related questions

1 like 0 dislike
1 answer
0 like 0 dislike
1 answer
1 like 0 dislike
1 answer

Welcome to MathsGee Q&A Bank, Africa’s largest personalized FREE Study Help network that helps people find answers to problems and connect with experts for improved outcomes.


Get help from experts - simply ask your question


You can Support MathsGee with your DONATION

Enter your email address:

13,101 questions
10,327 answers
101 comments
11,179 users