What Is A Split Test? | A Powerful Tool For 2020

0 20 Comments

What do you like red or green?

The internet is a prominent place connecting all sorts of people with different needs, backgrounds, education levels, beliefs, personalities, and so on. As such, the content you provide will be received with mixed results based on who’s viewing it at the time. Even timing plays a role.

In a perfect world, one size fits all would be ideal. Of course, we don’t live in a perfect world, so we tend to strive for something that appeals to the most massive audience in general. That’s not a wrong goal, but it’s far from what you could be doing, and you’re leaving a lot of potential clients on the table.

Today, I’d like to answer the question, “What is a Split Test?”. We’ll cover what one is, if it actually works, how to develop one, and tools to help with the process. By the time you’re done reading this article, you should have a firm grasp of slit testing and understand why you should be using it in your marketing endeavors.

Let’s start by defining what a split test is…


So, What Exactly Is A Split Test?So, What Exactly Is A Split Test?

Split testing (a variation of A/B testing) is a method used by many web developers to test various ways of presenting information and seeing which one performs better (i.e., which one gets the most conversions, sign-ups, sales, etc.).

Split testing can be quite simple or vastly involved, depending on your target audience, available time, budget, technical limitations, toolset available, and so on. You may simply want to test out a color or button style change, or you might be looking to see if a completely new design and layout works better.

Now, split testing isn’t a “find out what’s best and stick to it” scenario. At least, not entirely. Yes, you want to see what works and apply that, if your end goal is to get the most conversions, which is usually the case. But, what if you’re targeting different types of clients for the same product or service?

Let me take a stereotypical scenario to help drive my point home (no offense is intended). Let’s say you are promoting a well-known restaurant chain. We’ll call it McExample’s. Chances are, you’re going to feature that chain’s flagship burger. That makes sense. Now, let’s say you’re promoting that same company in a country such as India… The burger may not be the right product for that demographic. The Chicken McCurry might be a better fit. Of course, you might want to create two promotions and test them on the target audience to be sure.

I know that was a bit extreme, but I think you get what I was going for. Context matters. Demographics matter. The way you present your promotion matters.

My example above was a bit over-the-top. I just wanted to make sure that my point was hard to miss. That said, you don’t have to go so far as to offer different products or services to different demographics. Something as simple as changing the color of a button, making a price larger or smaller, adding or removing the decimal places or a symbol, etc. can make the difference between a conversion and bounce.

This is true even within the same target audience. Different people react differently to the same subject matter. This is why split testing is so important. It’s universally beneficial in both diverse target markets as well as within a single one.

Now, let’s discuss if it actually works…

Does Split Testing Actually Work?Does Split Testing Actually Work?

Yes, it absolutely does! Just take a look at the real business behind my hypothetical company above. Millions of dollars are spent annually by many large companies. Yes, a lot of that goes to paying various networks for air time and playing an ad, but a large chunk goes to advertising agencies to develop the ads.

Well, guess what? Those agencies want to keep getting that money, so they need to make sure the ads appeal to large sections of the population. They have focus groups, surveys, and so on to help them determine which version of their ad speaks to most people but, more importantly, gets them to take the desired action.

I’ve been in one of these focus groups (but for an auto manufacturer), and I can tell you that they really do want to know everything you think about what’s presented to you. From appearance to taste to what the ad tells you about the product or service. They’ll even throw a couple of versions of their ad out there to see which one you like best and what emotions and actions they invoke, etc.

The same can apply to your website(s). Does green work better than red? Should the price or money symbol be larger or smaller? What about the order of the information presented? Even the image(s) associated with your content can make all the difference.

I want to expand on the image comment… Let’s say you’re promoting a baby pacifier product. Would a picture of a smiling baby be better than one of a sleeping baby or even one that shows the pacifier with some statistics about its antibacterial properties?

The answer is, it depends. Who’s looking at that image? Is it an exhausted mother who wants a few moments of peace (sleeping baby)? What if it’s someone who’s more of a germaphobe (antibacterial)? Maybe it’s a parent who just wants the kid to stop crying (smiling baby).

As you can imagine, each of the picture options above will invoke a stronger desire to consider the product, based on their current situation. Split testing works.

So, how do you go about setting one up? Let’s take a look…

How Do I Go About Developing A Split Test?How Do I Go About Developing A Split Test?

So, now you know that split testing does work. The trick is to figure out what options appeal more to the largest audience in your target demographic. That’s where split testing comes into play.

Figure Out What You Want To Test

The first thing you’re going to want to do is to determine what type of change you want to test. Is it something small like changing a color, font, or image, or is it something big like appealing to a completely different demographic?

Each of these would require a different strategy. Changing a color is simple enough. Duplicate the content and change the one element. Appealing to a different audience would be a bit more involved could potentially require rewriting the content entirely.

Either way you go, you’re going to create an additional (if not more) version of your content, with the changes you wish to test so that you can refer your target audience to the right one.

Direct Traffic To The New Content

Creating additional content that reflects the changes you wish to test is only one part of the process. You need to direct visitors to this new content. This can be a bit tricky.

If you’re simply looking to test a color change and aren’t targeting a specific visitor base, you’re going to want to randomly send visitors to the new test content as well as the old. After a while, you can check various statistics to see if one version is getting the desired results more than the other(s).

If you’re looking to test against specific audiences, then you’ll want whatever medium that the audience is sourced from to send them to a particular test page. You may wish to redirect your Facebook or Pinterest followers to a specific version. You could have an ad that targets a particular group or feature offered by the product or service send traffic to a page that focuses on that point.

Track The Important Statistics

Once you have your test content ready to go and traffic flowing to it, it’s time to see if your desired results are trending in the right direction. Use your favorite analysis platform (i.e., Google Analytics) to track the statistics you’re looking to improve (i.e., bounce rate, conversions, session duration, etc.) and see which version is getting the best results.

Make Modifications And Repeat

After you’ve analyzed your findings, you can either fine-tune your test content and repeat the process to see if you can get better results or, if you’re satisfied, end the testing process, make the changes permanent or roll back to the original version.

It may seem like a lot of work, but it isn’t all that difficult to do and can make quite an impact on your site traffic and conversions. Remember, a lot of this is merely copying your content and tweaking it a bit here and there and then directing traffic to the new version.

One thing to note, people are impatient. If your content looks exceptional but takes 10 seconds to load, chances are you’ve lost a lot of traffic already. Consider that less can be more in such cases and test less flashy options too. The same goes for content length. You want to be thorough but not necessarily write a book in the process. It’s a balancing act in many cases.

Now, let’s talk about tools to consider for setting up and conducting a split test…

What Are Some Tools To Consider For Split Testing?What Are Some Tools To Consider For Split Testing?

There are a lot of tools out there that can be used in your split test endeavor. I’m going to cover them from research to implementation…

Google Analytics

Google Analytics should be your first stop. You can see what pages your visitors are viewing, how long they stay, when they exit, and so on. This is a great way to see what areas you might need to focus on.

Heat Maps

A heat map tool will show you what elements on your pages your visitors interact with. What they click on, hover their mouse, scroll, etc. You may discover that a widget you think is critical, may not be used at all and can be removed to streamline the look and flow of your site.

Visitor Input

Take a look at the feedback you get from your visitors. Site comments, direct emails, social media comments, review sites, and so on can give you great insights into what people think of your website, content, and more.

Session Recordings

Watch visitors navigate and interact with your website. You can glean critical information on where they may be hitting snags.

Usability Testing Tools

Some tools exist that will let you observe people interacting with your website so you can focus on fixing any issues with the user experience.

Your Mailing List/Auto Responder Service

There’s a saying, “the money’s in the list.”. That’s so true. Don’t just limit your testing to your actual website. Consider applying it to all of your marketing endeavors.

Social Media Platforms

This is the same as the mailing list option above. All of your marketing efforts can benefit from review and testing.

As you can see, there’s quite a bit of potential when it comes to both the tools available to you and the formats that can benefit from split testing. You don’t have to tackle it all at once. Pick one and focus on it first. Once you have the process down and that particular resource fine-tuned, move onto the next.


I know that this post has given you a lot to think about. Don’t feel overwhelmed. Break it down into small projects and just get started. You’ll be amazed as to the insight split testing can provide and hopefully more so when it comes to getting the results you’re looking for.

So, I hope I’ve answered the question “What is a split test?” and have given you food for thought.  If you liked this post, consider reading some of my other tip-related posts here.

Now, I’d like to hear from you. Have you used split testing in the past? If so, what insights did you glean from it, and were you able to obtain the results you were looking for? What tools do/did you use? Did I miss something you think should be included in this post? If you haven’t yet run a split test, are you planning to now? What results are you looking to obtain? Please let me know by commenting below.

Thank you,

Scott Hinkle



20 thoughts on “What Is A Split Test? | A Powerful Tool For 2020”

  1. Nate MC says:

    Years ago I never even thought about doing split testing because I didn’t really think it was necessary. But now I believe strongly in doing it. I found that sometimes something as little as changing up a color on a site or a sentence in an email can make all the difference in the world! 

    1. Scott Hinkle says:


           I was right there with you.  I was focusing on content but not really it’s application and presentation.  Believe me, these things matter.

      Thank you,


  2. Benny says:

    Hello, I really want to first appreciate your effort in putting this great website together and writing this article. It has been insightful getting to know some of the tools for split testing and I believe that by following the procedures here, it is sure that we can maximize the benefits to the fullest.

    1. Scott Hinkle says:

      Hi there,

           Thank you.  I’m glad you found this post of interest. If you apply the principal of split testing, I’m sure you can increase your conversions.

      Thanks again,


  3. Eric Seil says:

    This post was a very helpful review of a split test. The information is relevant when it comes to getting traffic, and ultimately conversions. 

    For those who are monetizing their websites, the outcomes are always to get conversions (whether sign-ups or sales). But they’re not always easy. Especially for myself as a current beginner. So your information really helped me out a bit. I’ll keep these things in mind, as I continue to build out my niche sites.

    Thanks for sharing- an excellent article!

    1. Scott Hinkle says:


           I’m glad you found my post helpful.

      Yes, split eating is a great tool to fine-tune your site and content to achieve your goals.

      Thanks for bookmarking this post for future reference.


  4. Fran says:

    I’m really glad you posted this information, Scott, because I have wanted to know more about split testing.  It seems to me that it is a great technique for learning what your audience responds to.

    Here’s my question:  Do you make changes on your original site and test with them, or do you get a SiteRubix site and test from that?  I’m a bit confused on how you run your changes by an audience. Would you create two different versions of your content in WordPress and then install first one, then the other, on your website? I’m not too sure how to set up the test.

    Yes, you’ve given me a lot to think about.  Will do my best to use your information in a helpful way.


    1. Scott Hinkle says:


          You’re welcome.  That’s the goal of this website.  To share information and help people build their online businesses.

      To answer your question, it depends on the test objectives.  If it’s a complete website redesign, I’ll probably build the new site on SiteRubix and direct traffic to it.  If it’s a simple color change, I might create a duplicate page (and just not index/follow it) and make the element change there.  Once I do that I’ll use a tool to send traffic to both pages and watch the statistics to see which one gets more favorable results (kind of like load balancing).  If it’s different because I’m targeting different demographics then I’ll usually have the two versions and have the associated ads or social media posts reference the correct one.  In those cases, I usually reword my content (basically saying the same thing in a different way) so that I don’t get dinged for duplicate content in the search engines as I want both versions indexed and followed so they can be found easily.

      Thank you,


  5. Rhain says:

    This information is spot on. Split testing is just as important as any other strategy that can be implemented to ensure business goals are met. As you rightly pointed out, the complexity of split testing depends vastly on quite a number of variables. 

    Variables like the demographic of the targeted audience, tools available at your disposal, even your budget. If you stop for a second to think of it, It becomes easier to grasp the overall idea.

    Great post

    1. Scott Hinkle says:

      Hi there,

           You’re right.  I was hoping that breaking it down as I did would help people grasp the subject a bit easier.  Yes, I actually recommend that people start out with a simple test, so they can get the hang of things before moving onto something more complex.

      Thank you for taking the time to comment.


  6. Danijel says:

    Hello Scott,

         I must say that this article is very helpful and informative. I heard about split testing but honestly, I never thought to learn about that but now I must.

    I am starting an email marketing campaign and this is a must. I am glad I stumbled upon your article because you explained everything so well and simple, I will definitely follow your tips.

    1. Scott Hinkle says:


           I was in your shoes too.  When I started out, I was just trying to learn the basics and split testing seemed like an advanced topic I could come back to.  To a degree, it is.  Now that I know what I’m doing and my site is up and running smoothly, it’s time to turn my focus to the fine-tuning and split testing.

      Thanks for commenting.


  7. Mugalu Mansoor says:

    Thank you very much, Scott


         First of all, thank you for the hard work to bring this useful website together and I appreciate the valuable content you provide here.

    I read this article and it interested me very much. It came into my mind that this concept of split testing is a vital thing for all business professionals.

    I would like to know, in split testing, are we trying to test for consumer preference?


    1. Scott Hinkle says:

      Hi there,

           Your welcome!  I try to provide content that’s useful to my user base.

      Split testing is vital to hone the performance and obtain the desired results from your website(s).

      Split testing is all about getting the desired result as best as possible.  To that end, it really is about consumer preference to a point.  Speed, ease of navigation, appearance all play a part in the consumer’s overall satisfaction.  Some people won’t wait long enough to see your content if it’s presented slowly.  Another frustration could be their inability to find what they’re looking for (navigation).  Let’s face it, we do a lot of our “shopping” visually.  If your site looks terrible, they may move onto green pastures.

      Thank you,


  8. Lisa says:

    Thank you for the detailed explanation of the split test, your examples are spot on to support your point. Having been involved in a focus group while undertaking my MBA I was continually surprised by the differences of opinion offered by the different market segments, it still seems odd that that opinions can vary so much!

    I’m very interested to understand how you structure your split tests. Do you use a particular tool to make sure that you don’t miss anything? Is there a key checklist that you use to track your testing?

    I’ve heard of Google Analytics, I will definitely use it on my current project; however, do you have any favourite programs for heat mapping and usability testing? These are areas in which I have no experience and would really welcome your advice.

    Thanks in advance!


    1. Scott Hinkle says:

      Hello Lisa,

           My number one tool for assessing my site’s “success” is Google Analytics.  if my drop rate is high or my visitors aren’t viewing other pages on my site, it’s time to make some changes and see if I can alter that.

      Most of my split tests are really recreating my content in a way that presents it to the target audience (i.e. the engineers might get a technical review, where the salespeople might get a synopsis, of features, etc.).  Every now and then, I’ll test a “new look” which might entail changing one or two elements to a full-blown website redesign, but those are very rare and usually triggered by a theme being discontinued or one offering a feature I didn’t know I needed when I created the site in the first place.

      As for favorite tools, look at my response to Jordan.  I haven’t used them all but, several of the tools listed in the link are pretty nice.

      Thank you,


  9. Jordan says:

    Hi Scott,

    Split testing is without a doubt at the core of every successful online business, every internet marketing should adopt it and will have to do split testing at some point in time.

    I was amazed by the fact that you mentioned factors like, colors, size of a dollar sign that may affect conversions!

    Also, I am very interested in the “Session Recordings” how is it done? How can I implement it? 



    1. Scott Hinkle says:

      Hello Jordan,

           Yes, split testing is crucial and can make a big difference in the results you obtain from your website(s).

      There are great publishings of research study results that talk about such things.  Check out the following for examples on pricing alone:



      As for session recordings, there are a lot of options out there.  Here’s an older reference, from 2017, that still offers some great options:


      Thank you,


  10. Hi there, You have done an incredible job. I will definitely digg it and personally suggest to my friends. I am sure they’ll be benefited from this site.

    1. Scott Hinkle says:

      Thank you. Feel free to share this site and its associated posts with anyone.


Leave a Reply

Your email address will not be published. Required fields are marked *

The reCAPTCHA verification period has expired. Please reload the page.