All Collections
Proactive Support
Series
Getting started
Test different paths with multivariate split testing in Series
Test different paths with multivariate split testing in Series

Test different message types, content, CTAs, and more. Find the best way to engage your users.

Beth-Ann Sher avatar
Written by Beth-Ann Sher
Updated over a week ago

Split (multivariate) testing lets you test different variants in a series to determine the best ways to engage with your customers.

Create up to 5 unique paths, and choose the percentage of customers who should proceed down each one:

Each test has its own goal, separate from individual message goals, or the series goal. With this level of detail it’s easy to test specific aspects of your customers’ experience.

Note: Check our plans and pricing to add this to your subscription.

How to create a split test

First, add a 'split test' block anywhere in your series:

Initially it will have two tests (A & B), or you can add up to 3 more, for a total of 5:

Define how many customers you’d like to proceed down each test path. This is a percentage of the total number of people who pass the Split test block, so it must total to 100%:

Pro tip: If one test is potentially higher risk (like a greater interruption for your customers), direct a smaller percentage of people towards it, until you see how it performs.

Now, set a goal for your split test. Try and focus on a specific part of the customer experience that you’re hoping to influence. If your Series goal is to encourage plan upgrades, you might split test different ways of getting customers to the upgrade page:

Control groups in split tests

In addition to testing different messages, you can also test your series against a control group who don't receive any messages at all. — No content blocks can be added to a control group path.

When setting up a split test, just click "+ Control group":

Then define the percentage of your audience which should be in the control group, and you'll see the control group on the series canvas:

Once the Series is set live, teammates can see the reporting stats for control group by clicking into the split test block.

Company data in split tests

If you use company data in rule blocks and have chosen not to prioritize a single company you have users who are members of multiple companies, they will be treated as two distinct combinations of user and company:

  • User at Company 1

  • User at Company 2

Important: Each ‘version’ of the user can proceed down a different variant in a split test. This means the same person may receive multiple variants. Read more about company data in series here.

Reporting for control group

Once the Series is set live, you can see which users have been added to the control group by clicking into the split test block:

Select a winning variant

After running your test for a period, you’ll see how each variant has performed against your goal, and can declare one the winner:

Any other variants will be paused, and everyone will proceed down the winning path automatically.

Tip: You can also see the stats for a control group, or declare it as the winning variant:

What’s next?


💡Tip

Need more help? Get support from our Community Forum
Find answers and get help from Intercom Support and Community Experts


Did this answer your question?