Tag Archives: risks

The Cost of Not A/B Testing – a Case Study

The cost of not a/b testing

Most of the time when discussing A/B testing, regardless of context, we discuss costs such as the expense of running an experimentation program, of shipping ‘winners’ to production. Only rarely do I see references to the less obvious, but usually more important costs in terms of opportunity cost (incurred during testing) and the cost of […] Read More…

Posted in A/B Testing | Also tagged , , , | Leave a comment

Inherent costs of A/B testing: limited risk results in limited gains

Costs

I’ve already done a detailed breakdown of costs & benefits in A/B testing as well as the risks and rewards and how A/B testing is essentially a risk management solution. In this short installment I’d like to focus on the trade-off between limiting the downside and restricting the upside which is present in all risk management […] Read More…

Posted in A/B Testing, Conversion Optimization | Also tagged , , , | Comments closed

Costs and Benefits of A/B Testing: A Comprehensive Guide

Costs and Benefits in AB Testing

This is a comprehensive guide to the different types of costs and benefits, risks and rewards related to A/B testing. Understanding them in detail should be valuable to A/B testers and businesses considering whether to engage in A/B testing or not, what to A/B test and what not to test, etc. As far as I […] Read More…

Posted in A/B Testing, Conversion Optimization | Also tagged , , , , , , | Comments closed