The Bane of AB Testing: Reaching Statistical Significance

Illusory Results AB Testing

Now, this is not a new topic on this blog. I’ve discussed the issue of optional stopping based on “achieving” or “reaching” statistical significance in my Why Every Internet Marketer Should be a Statistician post more than two years ago and others have touched on it as well – both before and after me. However, the issue […] Read More…

Posted in A/B Testing, Conversion Optimization, Statistical Significance, Statistics | Tagged , , , , , , , , , , | Leave a comment

Bayesian AB Testing is Not Immune to Optional Stopping Issues

Fantasy vs real world in bayesian ab testing

Fantasy vs the Real World: Naive Bayesian AB Testing vs Proper Statistical Inference This post is addressed at a certain camp of proponents and practitioners of A/B testing based on Bayesian statistical methods who claim that outcome-based optional stopping, often called data peeking or data-driven stopping, has no effect on the statistics and thus inferences […] Read More…

Posted in A/B Testing, Conversion Optimization, Statistical Significance, Statistics | Tagged , , , , , , , | Leave a comment

Future-Proofing Against Google Analytics Spam

A Spammer's View of the GA Home Report

Some two years after it gained prominence Google Analytics spam is all the rage again with one or several notorious spammers finding their way into hundreds of thousands of Google Analytics accounts in order to bring attention to stuff the spammer or his/her associates are making money off. The new wave started around Nov 8, […] Read More…

Posted in Google Analytics | Tagged , , , , , | 12 Responses

Language Spam – The Latest Google Analytics Spam

In the past 2 weeks we are witnessing a new wave of Google Analytics Spam – language spam and in this post I’ll outline what it is, how it happens and how you can protect your GA accounts from it (to some extent). We first started seeing it on Nov 8, just as the 2016 […] Read More…

Posted in Google Analytics | Tagged , , , , | 70 Responses

Get Your Google Analytics Tracking Code & ID and Check Your Setup

Google Analytics Tracking Code 2

OK, so you’ve decided that you’d start tracking your site with Google Analytics. Or you were given the task to install Google Analytics tracking on a site. In both cases you need to start by logging into a Google account (not necessarily a Gmail one), accepting the Google Analytics terms of service and then creating […] Read More…

Posted in Google Analytics | Comments closed

Using Content Groupings for User Flow Analysis in Google Analytics

Order Chaos Content Groupings

In the first part of this article we talked about how to set up content groupings in Google Analytics and how to make sure it’s working as expected. In this part we’ll discuss the 4 main benefits of having content groupings defined. If I have to sum it up in one word, I would go with […] Read More…

Posted in A/B Testing, Google Analytics | Tagged , , , , | Comments closed