What would happen if you suddenly pulled the plug on your website optimization efforts? The question behind the question is, “How much has website optimization contributed to our online sales?”
We all know that the results we see in our tests don’t reflect reality when rolled out to the website. So, how much faith should we put into test results?
My Marketing Land column The Nagging Little Question Of Conversion Optimization I explore all of the things that make our actual results different from that predicted by testing.
And I tell you what happened to one company when they removed the months of optimized changes from their site.
The Massey Observer Effect states that,
“The act of measuring an audience will change the way the audience behaves.”
This means that what our tests tell us are going to be somewhat inaccurate. This is just one reason that the results of our tests won’t be seen when rolled out onto the website.
You’ll learn how to overcome several sources of error in our tests.
- The Massey Observer Effect
- Statistics Lie
- Test Segments
- Market Coincidences
I go into detail on each of these, explaining why these issues is important and how to overcome them when doing website optimization for leads and sales.
Photo © 2015 Third Door Media, Inc. All rights reserved.
- We A/B Tested a Web Form Against a Quiz. Here is what we learned. - July 20, 2023
- How to Compare Data When You Move from Google Analytics to GA4 - April 7, 2023
- CRO and SEO Working Together with Jason Fisher - November 17, 2022