Tag Archives: test sensitivity

The Importance of Statistical Power in Online A/B Testing

Statistical Power and Test Sensitivity

What is Statistical Power? In null-hypothesis statistical testing (NHST) – the procedure most commonly applied in A/B tests, there are two types of errors that practitioners should care about, type I and type II errors. Type I is the probability of the test procedure to falsely reject a true null hypothesis. Type II error is […] Read More…

Posted in A/B Testing, AGILE A/B Testing, Conversion Optimization, Statistical Significance, Statistics | Also tagged , , , , | Leave a comment