Articles on generalizability

The search for the best statistical model for A/B testing

The best statistical model for A/B testing

It’s been almost ten years since I published the white paper “Efficient A/B Testing in Conversion Rate Optimization: The AGILE Statistical Method” (2017). It argues that Group-Sequential Tests (GSTs) are ideally-suited for online A/B testing. I figure it is a good time to reflect back on my search for the best statistical model and see […] Read more…

Posted in A/B testing, AGILE A/B testing, Statistics | Also tagged , , , ,

Representative samples and generalizability of A/B testing results

Representative samples and generalizability of AB testing results

I see a nice trend in recent discussions on A/B testing: more and more people realize the need for proper statistical design and analysis which is a topic I hold dear as I’ve written dozens of articles and a few white-papers on. However, there are cases in which statistical validity is discussed without consideration for […] Read more…

Posted in A/B testing, Conversion optimization | Also tagged , , , , ,