Usability Testing at the Conversion Conference with Steve Krug [INFOGRAPH]

Steve Krug gave an inspiring and enlightening Keynote presentation at Conversion Conference NY 2011, and we captured his wisdom using Instagraph technology for your viewing pleasure.

Steve Krug Keynote "You're Not Doing Usability Testing? Are you nuts?"

What is the right conversion recipe for your business? Find out in the free online conversion video, "So What Kind of Website are You Running Anyway?"

Tags:
  • Agree with the points you made above Brian. Quite insightful.

  • VoiceTranscribing

    Thanks for the article Brian. Yes, more and more of our clients use our transcription service http://voicetranscribing.com to transcribe their podcasts, webinars, interviews and generate content for blog posts.

  • Hi Kristi,

    I can respond with a lengthy comment, arguing the futility and wastefulness in running A/A or A/A/B etc. test, but I’ve already done an article on that back in 2014, so I’ll just share that: http://blog.analytics-toolkit.com/2014/aa-aab-aabb-tests-cro/ If you’d like to check it out and, hopefully, respond to it I think it will be beneficial for the readers of this blog.

    Kind Regards
    Georgi

    • Thanks, Georgiev. When you have a test setup that spans multiple domains, servers and security features, an A/A test is critical. We have been saved by A/A tests. In response to your excellent article I ask, “Which is more wasteful: Running a series of A/A tests or running a series of A/B tests that result in the wrong decisions?” The latter can impact sales for months or years.

      • Sounds like an unusually complicated test setup there, Brian. What kind of problems did those many A/A tests reveal? Randomization issues? User experience uniformity issues? Statistical engine issues? I’m just thinking there has to be a better way to detect & debug most of these, but the statistical engine ones…

        • We never really found the smoking gun, but we suspected cookie persistence issues, iframe security delays, page load times, etc. We redesigned the approach and verified the setup with an A/A test.

  • nrennie

    Thanks for removing my comments @bmassey:disqus.

    Surely constructive criticism is part of making things better, and excluding a market leader from your “Top tools” was exactly this?

    So my valid point was why not include Maxymiser? It’s a huge gap in your post.

    • Cut the sarcasm, @nrennie. It’s never appropriate. You commented on the wrong post here. I assume you meant to post on “The Most Recommended AB Testing Tools by Leading Experts”. I’ll reply to your comment there, but we didn’t list Maxymiser because nobody recommended it. Our team used it for one client and found it lacking on several key features.