REQUEST A CONVERSION STRATEGY SESSION   |   888-961-6604
Conversion Sciences
  • CRO Services
  • About
  • Contact
  • Book a Consultation
  • Menu Menu

Become a Statistically Significant Marketer [AUDIO]

CRO Tests | Multivariate | AB Testing

Statistical significance: It’s not just for impressing your date anymore.

Conversion-Scientist-Podcast-Logo-1400x1400


https://media.blubrry.com/customercreationequation/content.blubrry.com/customercreationequation/Conversion_Scientist_Podcast-The_Statistically_Significant_Marketer-MarketingLand.mp3

Podcast: Play in new window | Download

Subscribe to Podcast


If you’re involved with an online business, you draw conclusions from things you’ve learned on a weekly basis.

When you say, “We tried that. It didn’t work,” you are claiming to be able to predict the future based on something you did in the past.

When you say, “We stopped sending email because our list got tired of us,” you are saying that the tea leaves of your email list say you should stop sending email.

Often, such statements stop progress. One way to keep from hitting the “We tried that” wall is the ask a simple question: “Was the data statistically significant?”

In this episode of The Conversion Scientist Podcast, I will tell you exactly what statistical significance means, how to measure it and when to believe the data you’re being shown.

Read the Transcript

Image taken from ABTestGuide.com statistical significance calculator.


21 Quick and Easy CRO Copywriting Hacks to Skyrocket Conversions

21 Quick and Easy CRO Copywriting Hacks

Keep these proven copywriting hacks in mind to make your copy convert.

  • 43 Pages with Examples
  • Assumptive Phrasing
  • "We" vs. "You"
  • Pattern Interrupts
  • The Power of Three

"*" indicates required fields

This field is for validation purposes and should be left unchanged.


  • Author
  • Recent Posts
Brian Massey
Brian Massey
Conversion Scientist™ at Conversion Sciences
Brian Massey is the Founder and Conversion Scientist™ at Conversion Sciences, a sought-after international speaker, and author of Your Customer Creation Equation. He is passionate about transforming websites through a steady diet of visitor profiling, purposeful content, analytics, and AB testing.

Expertise: conversion rate optimization, AB testing, marketing strategy, digital marketing, analytics, landing page design, computer programming, entrepreneurship

Speaking: IBM, Inbound, LeadsCon, Content Marketing World, Affiliate Summit, and more

Books and Training: Your Conversion Creation Equation, Video CRO, Marketing Videos that Convert, CRO Best Practices

As Seen On: ClickZ, Search Engine Land, Marketing Land, Conversion Sciences Blog, Intended Consequences podcast

Education: Texas A&M University, BS Computer Science and Management
Brian Massey
Latest posts by Brian Massey (see all)
  • Your Traffic Fell 30 Percent. Your Targets Did Not. - September 3, 2026
  • How to Filter Bot Traffic in Google Analytics With Ask Advisor - August 20, 2026
  • Using AI to Chat with your Online Business - July 10, 2026
  • 0SHARES
July 27, 2014/by Brian Massey
You might also like
The Social Funnel includes both the traditional and post-purchase funnels. Why Our Website Redesign Wasn’t a Disaster [WEBINAR]
The bouncers in our brains and what to do about them. Getting Past the Bouncers in our Brains- Chinwag Psych Conference Presentation
The Social Funnel includes both the traditional and post-purchase funnels. Google Analytics Setup Basics [Audio]
The Social Funnel includes both the traditional and post-purchase funnels. Tides of Your Website and Tests that Lie [AUDIO]
The Social Funnel includes both the traditional and post-purchase funnels. What is Your Social Conversion Rate?
The Social Funnel includes both the traditional and post-purchase funnels. Research: Websites That Follow Convention are More Trustworthy, Convert Higher
11 replies
  1. Neville Bezzina
    Neville Bezzina says:
    July 29, 2014 at 8:40 am

    Really helpful stuff

    • Brian Massey
      Brian Massey says:
      July 29, 2014 at 9:24 am

      Thanks, Neville.

      • Neville Bezzina
        Neville Bezzina says:
        August 5, 2014 at 3:41 am

        Would you be interested in coming to Malta to train some of our clients? It’s very sunny here :)

  2. Kostas
    Kostas says:
    August 1, 2014 at 6:08 pm

    Hi Brian, thanks for this episode of the podcast. I found it really interesting and I will be looking to learn more about this.

  3. David Curry
    David Curry says:
    April 7, 2015 at 4:02 am

    Great stuff!
    Thanks for sharing with us. I use a more interactive tool for A/B testing:
    http://www.coreminer.com/calculators/ab-test

Trackbacks & Pingbacks

  1. Multivariate Testing (Test Multivarié) : Risques et Opportunités - Blog Convertize says:
    November 28, 2018 at 8:13 am

    […] La significativité statistique est le point où nous sommes confiants que les résultats obtenus lors du test se reproduiront dans le futur. Il est donc possible de déployer les variations gagnantes de façon durable. Pour de plus amples informations sur ce sujet, vous pouvez lire (en anglais) : Questions That Will Make You A Statistically Significant Marketer ou écoutez la version audio. […]

  2. Multivariate Testing: Promise and Pitfalls for High-Traffic Websites | Conversion Sciences says:
    July 1, 2016 at 12:18 pm

    […] Statistical Significance is the point at which we are confident that the results reported in a test will be seen in the future, that winning variations will deliver more conversions and losing variations would deliver fewer conversions over time. Read 2 Questions That Will Make You A Statistically Significant Marketer or hear the audio. […]

  3. How to be a Statistically Significant Marketer [Audio] — Your Customer Creation Equation says:
    August 22, 2014 at 10:29 am

    […] Part 1: 2 Questions That Will Make You A Statistically Significant Marketer Find the audio here. […]

  4. How to be a Statistically Significant Marketer [Audio] | Your Customer Creation Equation — Your Customer Creation Equation says:
    August 22, 2014 at 10:23 am

    […] Part 1: 2 Questions That Will Make You A Statistically Significant Marketer Find the audio here. […]

  5. 2 Questions for the Statistically Significant Marketer Part 2 [Audio] : The Conversion Scientist says:
    August 21, 2014 at 1:44 pm

    […] You will find part one here: Become a Statistically Significant Marketer. […]

  6. How 18% of Companies Are Owning Their Corner of the Web with CRO : The Conversion Scientist says:
    August 20, 2014 at 9:26 am

    […] business software on the Web, and were able to get 4100 companies to complete the survey. This is statistically significant […]

Comments are closed.

Search Search

Free Ad Alignment Report

Are your ads making promises that your landing pages aren't keeping. We'll pull your entire portfolio and grade the landing pages.

"*" indicates required fields

This field is for validation purposes and should be left unchanged.
This field is hidden when viewing the form

Free for a limited time.

Conversion Optimization Course (FREE CRO Training)

Sign up and read the nine articles we will email you.

  • This field is for validation purposes and should be left unchanged.

Latest Articles

  • CRO vs. AI. Who Wins? Images of Sahil Patel and Brian Massey Conversion Sciences LLC
    Your Traffic Fell 30 Percent. Your Targets Did Not.September 3, 2026 - 10:36 am
  • "The visitors that are eating your conversion rate" with bugs attacking the words "your conversion rate" Conversion Sciendes
    How to Filter Bot Traffic in Google Analytics With Ask AdvisorAugust 20, 2026 - 11:16 am
  • Brian Massey in a lab coat and a data monster in the background. The caption says "Talk to your analytics" Conversion Sciences LLC
    Using AI to Chat with your Online BusinessJuly 10, 2026 - 2:31 pm

Blog Article Categories

  • Advertising CRO
  • Artificial Intelligence
  • Conversion Marketing Strategy
  • Conversion Optimization
  • Conversion-Centered Design
  • CRO Tests | Multivariate | AB Testing
  • Ecommerce CRO
  • Landing Page Optimization
  • Lead Generation
  • Persuasion Science
  • Web Analytics
Conversion Sciences | Best Conversion Optimization Agency

FacebookTwitter/XPinterestLinkedInNews/RSS FeedPodcast

  • Conversion Optimization Services
    • Optimization Services
    • Guaranteed Redesign
    • Fully-managed CRO
    • CRO Audit
    • AI Optimization
    • CRO Training & Coaching
  • CRO Solutions
    • Conversion Solutions
    • eCommerce Optimization
    • Lead Generation Solutions
    • CRO for Website Redesign
    • CRO for Mobile Lead Gen
    • CRO for Advertising
  • About
    • About Conversion Sciences
    • Contact
    • Success Stories
    • CRO Resources
    • Blog
    • Your Customer Creation Equation Book
    • Free CRO Course
    • CRO Calculator
    • Press & Speaking Dates
Free — $10,000 Value

See Exactly Where Your Website Is Losing Revenue

In a free 30-minute session, a Senior Conversion Scientist will audit your site and deliver actionable recommendations.

🛡️ Backed by our Guaranteed ROI commitment — if we don't deliver results, you don't pay.
What you'll walk away with
✓

Personalized site audit of your highest-traffic pages with specific conversion gaps identified

✓

3–5 prioritized recommendations you can implement this week — whether or not you hire us

✓

Honest ROI assessment based on your traffic and conversion data

✓

1-on-1 with a Senior Conversion Scientist (avg. 8+ years CRO experience)

Intuit Boingo AMEX GBT + 300 more
Book your free session

"*" indicates required fields

This field is for validation purposes and should be left unchanged.

You'll receive a calendar link within 1 business hour.
Free. No commitment. 30 minutes.

"At present, we see around 10X ROI. We're truly happy with what Conversion Sciences has brought." — StewMac

© Copyright 2007 - 2026 • Conversion Sciences • All Rights Reserved
Conversion Sciences® and Conversion Scientist® are
federally registered trademarks of Conversion Sciences LLC.
Any unauthorized use is expressly prohibited.
  • Privacy Policy
  • Terms of Service
  • Disclaimer
  • Cookie Policy
  • Security
  • Jobs
Link to: Conversion Copywriting Guide: Transactional vs. Relational Buyers Link to: Conversion Copywriting Guide: Transactional vs. Relational Buyers Conversion Copywriting Guide: Transactional vs. Relational Buyers Link to: How Many Steps Should Your Online Checkout Have? [CASE STUDY] Link to: How Many Steps Should Your Online Checkout Have? [CASE STUDY] How Many Steps Should Your Online Checkout Have? [CASE STUDY]
Scroll to top Scroll to top Scroll to top