Monthly Archives: February 2020

Frequentist vs Bayesian Inference

Frequentist vs Bayesian Inference

In this article I’m revisiting* the topic of frequentist vs Bayesian inference with specific focus on online A/B testing as usual. The present discussion easily generalizes to any area where we need to measure uncertainty while using data to guide decision-making and/or business risk management. In particular, I will discuss each of the following five […] Read More…

Posted in A/B Testing, Statistics | Tagged , , , , , , , | Leave a comment

Underpowered A/B Tests – Confusions, Myths, and Reality

Underpowered A/B Tests

In recent years a lot more CRO & A/B testing practitioners have started paying more attention to the statistical power of their online experiments, at least based on my observations. While this a positive development for which I hope I had contributed somewhat, it comes with the inevitable confusions and misunderstandings surrounding a complex concept […] Read More…

Posted in A/B Testing, Statistics | Tagged , , , , , , | Leave a comment

The Perils of Poor Data Visualization in CRO & A/B Testing

As any UX & CRO expert should now, the way we present information matters a lot both in terms of how well it is understood and in terms of the probability that it will lead to the desired action. A/B testing calculators and other tools of the trade are no exception and here I will […] Read More…

Posted in A/B Testing, Conversion Optimization, Statistics | Tagged , , , , , , , | Leave a comment