A/B Testing stands for “Always Be Testing”

I’m sure my customers @HubSpot always felt like I was a thorn in their side when I’d ask - “did you test that?” They’d typically respond with “no, I just needed to get it out the door.” Now that I’m responsible for executing on the strategies I set @Codesion I have to eat my own dogfood. I’ve got a ton on my plate this week, but I managed to squeeze in 2 small A/B tests for an email campaign I’m working on.

Here are the results. I used Mixpanel’s handy A/B split testing calculator.

Register Now vs. Sign Up

     

Register Now - 0.40% conversion rate

Sign Up - 0.56% conversion rate

** Sign Up wins with 95% confidence

Text Email vs. HTML Email

     

Text Email - 0.34% conversion rate

HTML Email - 0.31% conversion rate

No clear winner yet

This is an interesting one that I’ll try again soon because the assumption is that our audience, typically developers, shy away from “marketing” messages so text emails should perform better. Stay tuned for the next test…

1 Notes/ Hide

  1. erincolbert posted this