You run an A/B test that looks at whether each user clicks a button or not. Which of the following distributions should you use in your analysis?
|
|
|
||
|
|
|
||
|
|
|
Imagine that you want to run an A/B test, and you think the treatment will improve your conversion rate, which is 10%. In that scenario, what is your null hypothesis?
The treatment of your A/B test has 2,659 impressions and 452 conversions. What is the conversion rate, rounded to the nearest percent?
What is the most common significance level (or alpha) used in A/B tests?
If the control had a conversion rate of 10% and the treatment a conversion rate of 17%, what was your observed lift?
Which of the following is true about the significance level (alpha) if the confidence level is 95%?
If you run an A/B test and you find a p-value of 0.03, which of the following is true?
To answer this question, you will need to use the calculator at: https://abtestguide.com/
To answer this question, you will need to use the calculator at: https://abtestguide.com/
The results of an A/B test are:
Control: 5687 Impressions | 524 clicks
Treatment: 5124 Impressions | 545 clicks
What was the uplift (lift) in conversion rate?
To answer this question, you will need to use the calculator at: https://abtestguide.com/
The results of an A/B test are:
Control: 5687 Impressions | 524 clicks
Treatment: 5124 Impressions | 545 clicks
What is the p-value as a percentage?
To answer this question, you will need to use the calculator at: https://abtestguide.com/
The results of an A/B test are:
Control: 5687 Impressions | 524 clicks
Treatment: 5124 Impressions | 545 clicks
If the alpha was 5% for this test, you would: