Skip to main content
All CollectionsCampaign Setup
A/B Testing Campaigns
A/B Testing Campaigns

You can create an evaluate multiple A/B tests for your campaigns to optimize performance. New Feature!

Ryan O'Donnell avatar
Written by Ryan O'Donnell
Updated over a week ago

A/B testing creates an opportunity to apply data to your decision making in selecting the right subject lines and email copy for your campaigns.  

Setting up an A/B Test for a NEW Campaign

  1. Go to your Campaign Stats page and click the plus button next to Timeline A.

  2. A modal window prompting you to select whether your new B Version (for example) should start with a base template from a previous timeline or if the B Version should 'start from scratch' which will give you the ability to create the new timeline with a blank slate.  (see image below)

  3. Once you make your selection from the dropdown, a new tab will open in your browser to edit/create the B Version.  Just remember to SAVE YOUR  CHANGES.

Pro Tip - You can have multiple (A/B/C/D) versions of a campaign running at the same time OR you can Pause/Active certain timeline versions.  So, for example, if you create a B version of your campaign, you can select to leave the A version LIVE or you can Pause the A version so just the B version will deliver.


Setting up an A/B Test for an Existing LIVE Campaign

If you'd rather extend your email sequence as opposed to creating a new timeline, please see this article on Managing a LIVE Campaign.  Here's how to set up an A/B/C/D test using Replyify.  (see image below the 1.2.3...)

  1. Go to your Campaign Stats page and click the plus button next to Timeline A.  Alternatively, you can select the 'Start A/B Test' link at the bottom of the Campaign Editor.

  2. A modal window prompting you to select whether your new B Version (for example) should start with a base template from a previous timeline or if the B Version should 'start from scratch' which will give you the ability to create the new timeline with a blank slate. 

  3. Once you make your selection from the dropdown, a new tab will open in your browser to edit/create the B Version.  Just remember to SAVE YOUR  CHANGES.

Campaign Delivery Across Multiple Timeline Versions

If you have 2 versions of the same Campaign LIVE (A and B), Replyify will automatically adjust sending to evenly assign contacts between your Active Timeline versions.  If you have 100 contacts eligible for 2 Active Timeline versions, Replyify will automatically assign 50 contacts to each.  

In the case where you have 100 contacts and 3 timelines, Replyify will assign 33 contacts to A Version, then 33 contacts to B version, then 33 contacts to C version, then we'll loop back to the A version for the remaining 1 contact.

Picking a Winning Campaign

You can pause a timeline to prevent that timeline from receiving any new contacts.  So, if you picked Timeline B (for example) as the winner and don't want new contacts going into Timeline A, select Paust Timeline A.  

Important:  Pausing Timeline A will prevent new contacts but will continue to send the remaining emails to all contacts previously set LIVE on timeline A.  

Pro Tip: If you picked a winner between an A/B test you can add a C version to test the winner against the new version.  Same process from above applies.

Have fun optimizing your campaign with A/B testing!

Did this answer your question?