Category Archives: AGILE A/B Testing

Posts on the topic of a/b testing using the AGILE statistical method.

The Importance of Statistical Power in Online A/B Testing

Statistical Power and Test Sensitivity

What is Statistical Power? In null-hypothesis statistical testing (NHST) – the procedure most commonly applied in A/B tests, there are two types of errors that practitioners should care about, type I and type II errors. Type I is the probability of the test procedure to falsely reject a true null hypothesis. Type II error is […] Read More…

Also posted in A/B Testing, Conversion Optimization, Statistical Significance, Statistics | Tagged , , , , , | Comments closed