The CRM specific challenges of A/B Testing & Statistical Significance
To understand whether any uplift we can see from campaigns is incremental, and wouldn’t have happened naturally, randomised control groups are a proven tactic. This way we can be sure that any difference in purchase behaviour between our test and control groups is down to the campaign. Well, it’s not always quite that simple, let's explain some more.