What is Statistical Power? In nullhypothesis statistical testing (NHST) – the procedure most commonly applied in A/B tests, there are two types of errors that practitioners should care about, type I and type II errors. Type I is the probability of the test procedure to falsely reject a true null hypothesis. Type II error is […] Read More…

Recent Posts
 Bayesian Probability and Nonsensical Bayesian Statistics in A/B Testing
 The Perils of Using Google Analytics User Counts in A/B Testing
 The Effect of Using Cardinality Estimates Like HyperLogLog in Statistical Analyses
 Error Spending in Sequential Testing Explained
 Updates to Our A/B Testing Statistical Calculators
Categories
Archives
 October 2020
 May 2020
 March 2020
 February 2020
 January 2020
 November 2019
 October 2019
 September 2019
 March 2019
 December 2018
 October 2018
 September 2018
 August 2018
 June 2018
 April 2018
 March 2018
 November 2017
 October 2017
 September 2017
 August 2017
 July 2017
 May 2017
 November 2016
 May 2016
 March 2016
 January 2016
 November 2015
 October 2015
 September 2015
 August 2015
 July 2015
 June 2015
 March 2015
 January 2015
 October 2014
 September 2014
 August 2014
 July 2014
 May 2014
 April 2014