referral marketing

Statistical significance: It’s not just for impressing your date anymore.


Subscribe to Podcast

If you’re involved with an online business, you draw conclusions from things you’ve learned on a weekly basis.

When you say, “We tried that. It didn’t work,” you are claiming to be able to predict the future based on something you did in the past.

When you say, “We stopped sending email because our list got tired of us,” you are saying that the tea leaves of your email list say you should stop sending email.

Often, such statements stop progress. One way to keep from hitting the “We tried that” wall is the ask a simple question: “Was the data statistically significant?”

In this episode of The Conversion Scientist Podcast, I will tell you exactly what statistical significance means, how to measure it and when to believe the data you’re being shown.

Read the Transcript

Image taken from statistical significance calculator.

21 Quick and Easy CRO Copywriting Hacks to Skyrocket Conversions

21 Quick and Easy CRO Copywriting Hacks

Keep these proven copywriting hacks in mind to make your copy convert.

  • 43 Pages with Examples
  • Assumptive Phrasing
  • "We" vs. "You"
  • Pattern Interrupts
  • The Power of Three

"*" indicates required fields

This field is for validation purposes and should be left unchanged.

A “split” is not usually considered a good thing in the world of prophylactics. However, a condom shop that is “split testing” is going to have happy customers and prosperous owners.
I had the great pleasure of visiting Estonia and the Netherlands on a speaking tour. While in the Netherlands I stayed in a real 19th century windmill, hung out in an 18th century farm house, and walked by a condom shop housed in a 16th century building.
There are a lot of old places in the Netherlands.
I mention the condom shop because I discovered that this shop, called Condomerie® was split testing their store front.
It begs an important question: if a condom shop in the red light district of Amsterdam is split testing, why aren’t you? We can get you started.
While I was impressed that the Condomerie was split testing their products, I was just as excited about the number of condom jokes I could make in a blog post.
Start counting.

The Windows of Condomerie

The store front of the Condomerie was tasteful, consisting of two large windows separated by a door. In each window a selection of condoms were well-hung, having been blown up like a balloon to show off the size and shape.
I found the collection of colorful condom most interesting. As you can see from the photo below, these condoms were animals, vegetables, soccer balls, skeleton heads… there was even a Eiffel Tower condom. You needn’t worry about size when you’re sporting the Eiffel Tower.
And what says “I love you” better than a condom that says “I love you?” See them all in the picture below.

The front window of the Condomerie

Click to “Enlarge” (snicker)

A condom with a QR code on it.

The Qondom

Being a geek, my attention was drawn to an artificial condom made from laminated paper that contained a secret QR code. I call it a QR condom, or Qondom.
Scott Stratten says that every time a QR code is used a kitten dies. However, you have to get creative when designing tests. Use whatever tools are at your disposal.
I scanned it with my phone to see where it would take me. The URL contained a word my Dutch friend understood: “Right”.
We looked to the left window. Sure enough, there was a qondom there too. When I scanned it, the URL that was revealed contained the Dutch word for “Left.”
The Condomerie was split testing its windows! They had placed a Trojan Horse in the window designed to trap sightseers with smartphones.

The Hypothesis

If they were doing a good job of testing, they would be working from a specific hypothesis. At a glance, the hypothesis became pretty clear:
“If we display our funny condoms in the window, we will draw more attention and sharing as measured by QR Code scans and visits to our website.”
Their test placed the colorful cartoon condoms in the right window. I’m going to call this the right-brained window that’s creative, emotional and completely unconcerned that these condoms are far more intricate than necessary.
On the other side were condoms arranged primarily by size. This is the left-brained, “just the facts” side of the store. You can imagine that those interested in this window would be looking for a calibration scale to ensure they got the best fit.

The left window of the Condomerie is about size and fit.

The left window of the Condomerie is about size and fit.

The right Condomerie window features colorful and whimsical condoms.

The right Condomerie window features colorful and whimsical condoms.

Which window would you linger at? The left-brain, functional window? The right-brain imaginative window? Or, the window of the cheese shop next door?
At this point, only the proprietors of the Condomerie know.

An Inflated Sample

A problem with this test is that only tech-savvy condom users with smart phones are going to be part of this sample. Those with feature phones and those who’ve never bothered to load a barcode scanner app will not be able to participate.
This is a real problem, as it probably skews the results, inflating the sample toward early adopters. The sample taken wouldn’t be expected to represent the typical condom-buying public.
There are some fundamental issues with the landing pages that may be suppressing conversions, but we can expect all marketing channels to improve as an organization learns from split testing.
This shop is learning something about their tech-savvy audience, an audience who can often afford the more expensive condoms and profitable condoms. Revenues can be expected to rise when tested changes are rolled onto the shop floor.
What are you learning about your website visitors? How are you testing your assumptions about what people want, like and are persuaded by? Testing is the most effective way to consistently increase your revenue. The Condomerie knows this and so should you.
Let Conversion Sciences get you started on a website split testing program that will get more revenue from the traffic you already have.
Get a free copy of my book if you are the first person to provide a correct count of the double entendre in this post. Put your number in the comments.

Conversion optimization is now a recognized discipline in the digital marketing stack. This stack roughly looks like this:


  1. Brand Development

  3. Awareness Advertising

  5. Web Property Development

  7. Search Marketing

  9. Conversion Optimization

  11. Loyalty and Evangelism

According to, increasing conversion rates is at the top of business’s digital priorities in 2014.
“Testing and Optimization” is in the top three of 21% of respondents to this survey. As it turns out, test data is ideal for “Leveraging actionable data”, which 21% also put in their top three.
For most businesses, the digital marketing stack is delivered by one or more digital agencies.
When is the right time for these agencies to begin offering conversion optimization services? We think it’s now, and we’d like to provide you with this capability. When I talk about conversion optimization, I mean the following process:


  1. Analyzing a property and its data.

  3. Identifying issues and opportunities to increase the performance.

  5. Testing to identify what increasing leads, subscribers and sales.

In our experience, it is wholly insufficient to stop with step 2. Step 3 provides the measureable revenue increases that these services deliver.

Conversion Optimization Delights Clients

We know you are being asked by your clients to provide conversion optimization services. Instead of saying, “We don’t do that,” you should take this chance to demonstrate your ability to help them find more revenue in measureable ways. Send them to Conversion Sciences.
We have an impressive track record.


  • Our basic process has increased revenue at every one of our clients.

  • Nine out of ten of our clients continue with us after our initial “Catalyst” process.

  • Our long-term clients experience doubled and tripled conversion rates.

  • Many of our happiest clients are referrals from agencies like yours.

We can deliver a complete turnkey optimization solution to your clients today.

Send Us the Business

If your clients are asking about conversion optimization, we say, “Send them our way.”
Call us now and we’ll give you detailed insight into our process and referral agreements.
Conversion Sciences
+1 (888) 961-6604 Toll Free
+1 (512) 961-7159 Direct
Thanks to Peep Laja for the pointer to the data.

Champagne Fountain Your presentation will set off a cascade of content.

It was a few paragraphs from my book in a Chapter entitled “How Content Fuels Conversion.”

It started off pretty well, but it ended in a lie.

Amid my discussions of video and images; of draftsmen and imagemakers and storytellers appeared a few lines. They’re there on page 92.

Digital content has legs. One item of content can be cascaded into a variety of channels like a fountain of champagne glasses at a wedding.

For example, how many opportunities do your employees get to present at conferences, training sessions, seminars, and webinars? Film them and record good quality audio. This bubbly content fills the top glass of your cascade.

Have someone edit the video into a series of shorter videos, ripe for YouTube and other video services. You’ve just filled the next layer of glasses.

Share the slides used on slide-sharing services such as Slideshare and Scribd. Voila—another, wider layer glasses fills  with sparkling champagne.

For just a few dollars, the video can be transcribed. Lay this out as a report or white paper and distribute it for lead generation. Another layer of glasses fills.

I go on to describe how this transcription turns into blog posts, social media posts and more. I then go on to tell the lie.

The transformations discussed in this example are often not time-intensive.

The truth is, that they are not as time-intensive as creating the content from scratch. But these transformations do take time.

My idea has been stolen

Since the publication of the book, I’ve tried to get someone to steal my idea so that I would have a resource to turn to. I’ve had conversations with a number of agencies and freelancers about why content is like champagne. Businesses are creating the champagne every day. They just need glasses, stacked just so to turn it their content into an online party.

Dust off one of your presentations

How many people saw that webinar you recorded last quarter? Most webinars draw less than 100 viewers. There are a lot more people out there who won’t watch a webinar, but who are qualified prospects. I invite you to dust off your webinar or presentation and turn it into a Slideshare presentation, blog posts, a report, an eBook – you choose the package.

Most importantly, create the content landing pages and social media posts that generate sales and leads. After all, this content is only valuable if it grows your business.

Every so often, your CEO is asked to speak about some aspect of the market. Every now and then, your tech guru is asked to talk about how brilliant your technology is. And how many times is your sales team pitching to audiences about your fantastic offering? Each of these moments is an opportunity for a cascade of content for your marketing efforts.

Is your presentation cascadeable?

Here’s how you can tell if your content is a good match for the cascade:

  • Do you have recorded audio or video of the presentation? Slides are rarely enough to convey the understanding needed for someone to do a good job creating content. The quality of your audio need only only be good enough to generate a transcript.
  • Do you have presentation slides? Video and recorded webinars don’t provide the resolution needed for visuals.
  • Is your presentation just slides full of bullets? These kinds of presentations don’t typically make for good visual content such as infographs, eBooks and reports.

Other than that, there’s no risk in uploading your presentation for us to look at. We don’t ask for a credit card.

The Audience is Bigger Than The Room

The audience that initially heard the presentation is tiny compared to the audience for the cascade of content it will generate.

  • Cascade content is shared with a larger audience via email and social networks.
  • Cascade content increases frequency with multiple slices from the same presentation.
  • Cascade content engages more of the audience through text, audio and images.

Photo courtesy paulodonnel on Flickr under the creative commons.

What makes people trust your Website more? As you know building trust with your visitors is critical to maximizing conversion. Here is some research that helps us to understand what makes visitors trust our site.
Here are some highlights.

An 11-minute Summary of Webpreep’s Research on the Web

1:43-People trust more attractive websites.
2:21-Attractive websites are those that follow conventions.
3:05-Biggest source of frustration? Ability to find relevant information.
3:31-Website owners must increase the relevance of their information.
5:00-The best way to retain customers is to provide relevant information.
Why Relevancy is dropping across the Internet.
6:10-How an Internet store is different from a physical store.
8:02-People who are on Facebook are more likely to recommend companies that they see on Facebook.
9:30-Satisfaction is what it is all about, affecting conversion and referral behavior.
10:00-Clam chowder

© Copyright 2007 - 2024 • Conversion Sciences • All Rights Reserved
Conversion Sciences® and Conversion Scientist® are
federally registered trademarks of Conversion Sciences LLC.
Any unauthorized use is expressly prohibited.