The 12 Days of CROstmas

Origami Christmas Tree 1
Image courtesy fangol on sxc.hu

On the first day of CROstmas my website gave to me

An increase in RPV.

On the second day of CROstmas my website gave to me

Two split tests and an increase in RPV.

On the third day of CROstmas my website gave to me

Three fresh sales, Two split tests and An increase in RPV.

On the fourth day of CROstmas my website gave to me

Four calling leads, Three fresh sales, Two split tests and an increase in RPV.

On the fifth day of CROstmas my website gave to me

Five Add to Carts

Four calling leads, Three fresh sales, Two split tests and an increase in RPV.

On the sixth day of CROstmas my website gave to me

Six bounces staying

Five Add to Carts

Four calling leads, Three fresh sales, Two split tests and an increase in RPV.

On the seventh day of CROstmas my website gave to me

Seven Testers testing, Six bounces staying

Five Add to Carts

Four calling leads, Three fresh sales, Two split tests and an increase in RPV.

On the eighth day of CROstmas my website gave to me

Eight maids emailing, Seven Testers testing, Six bounces staying

Five Add to Carts

Four calling leads, Three fresh sales, Two split tests and an increase in RPV.

On the ninth day of CROstmas my website gave to me

Nine tweeters tweeting, Eight maids emailing, Seven Testers testing, Six bounces staying

Five Add to Carts

Four calling leads, Three fresh sales, Two split tests and an increase in RPV.

On the tenth day of CROstmas my website gave to me

Ten forms completing, Nine tweeters tweeting, Eight maids emailing, Seven Testers testing, Six bounces staying

Five Add to Carts

Four calling leads, Three fresh sales, Two split tests and an increase in RPV.

On the eleventh day of CROstmas my website gave to me

Eleven cards a-clearing, Ten forms completing, Nine tweeters tweeting, Eight maids emailing, Seven Testers testing, Six bounces staying

Five Add to Carts

Four calling leads, Three fresh sales, Two split tests and an increase in RPV.

On the twelfth day of CROstmas my website gave to me

Twelve pages landing, Eleven cards a-clearing, Ten forms completing, Nine tweeters tweeting, Eight maids emailing, Seven Testers testing, Six bouncers staying

Five Add to Carts

Four calling leads, Three fresh sales, Two split tests

And an increase in RPV.

Happy Holidays from all of us at Conversion Sciences.

Post Signature

Brian Massey is the Founder and Conversion Scientist at Conversion Sciences. He is the author of Your Customer Creation Equation. His rare combination of interests, experience and neuroses were developed over almost 20 years as a computer programmer, entrepreneur, corporate marketer, international speaker and writer.

  • Agree with the points you made above Brian. Quite insightful.

  • VoiceTranscribing

    Thanks for the article Brian. Yes, more and more of our clients use our transcription service http://voicetranscribing.com to transcribe their podcasts, webinars, interviews and generate content for blog posts.

  • Hi Kristi,

    I can respond with a lengthy comment, arguing the futility and wastefulness in running A/A or A/A/B etc. test, but I’ve already done an article on that back in 2014, so I’ll just share that: http://blog.analytics-toolkit.com/2014/aa-aab-aabb-tests-cro/ If you’d like to check it out and, hopefully, respond to it I think it will be beneficial for the readers of this blog.

    Kind Regards
    Georgi

    • Thanks, Georgiev. When you have a test setup that spans multiple domains, servers and security features, an A/A test is critical. We have been saved by A/A tests. In response to your excellent article I ask, “Which is more wasteful: Running a series of A/A tests or running a series of A/B tests that result in the wrong decisions?” The latter can impact sales for months or years.

      • Sounds like an unusually complicated test setup there, Brian. What kind of problems did those many A/A tests reveal? Randomization issues? User experience uniformity issues? Statistical engine issues? I’m just thinking there has to be a better way to detect & debug most of these, but the statistical engine ones…

        • We never really found the smoking gun, but we suspected cookie persistence issues, iframe security delays, page load times, etc. We redesigned the approach and verified the setup with an A/A test.

  • nrennie

    Thanks for removing my comments @bmassey:disqus.

    Surely constructive criticism is part of making things better, and excluding a market leader from your “Top tools” was exactly this?

    So my valid point was why not include Maxymiser? It’s a huge gap in your post.

    • Cut the sarcasm, @nrennie. It’s never appropriate. You commented on the wrong post here. I assume you meant to post on “The Most Recommended AB Testing Tools by Leading Experts”. I’ll reply to your comment there, but we didn’t list Maxymiser because nobody recommended it. Our team used it for one client and found it lacking on several key features.