A/B Testing stands for “Always Be Testing”
I’m sure my customers @HubSpot always felt like I was a thorn in their side when I’d ask - “did you test that?” They’d typically respond with “no, I just needed to get it out the door.” Now that I’m responsible for executing on the strategies I set @Codesion I have to eat my own dogfood. I’ve got a ton on my plate this week, but I managed to squeeze in 2 small A/B tests for an email campaign I’m working on.
Here are the results. I used Mixpanel’s handy A/B split testing calculator.
Register Now vs. Sign Up
Register Now - 0.40% conversion rate
Sign Up - 0.56% conversion rate
** Sign Up wins with 95% confidence
Text Email vs. HTML Email
Text Email - 0.34% conversion rate
HTML Email - 0.31% conversion rate
No clear winner yet
This is an interesting one that I’ll try again soon because the assumption is that our audience, typically developers, shy away from “marketing” messages so text emails should perform better. Stay tuned for the next test…
Interesting…I’ve always despised the “click here” option, but it in this test of 400 users, it was the most clicked button. Go and Submit also did better than download and register - possibly due them being much less committal. I’d like to see how free trial buttons fit into the mix.
