Feedback Genius makes it easy to optimize your Buyer-Seller messages with its built-in A/B testing feature. What is A/B testing? In short, it allows you to compare and analyze a message’s open, click-through, and conversion rates by creating two versions of an email.

How to create an A/B test

Before setting up A/B Testing, you'll want to create an “A" message and a “B” message. Basically, two counterpart messages that you want to compare. These messages can have different message content, different subject lines, and be sent at different times.

You can create a copy of a message and change one thing between the two messages. However you decide to test your messages, be sure that you have two created for later comparison of open rates.

After creating your two messages, you can set up A/B testing from the Filters section within your message. You can find A/B testing under “Show Advanced Filters.” From here, you will work in the section titled “Only Include Orders Ending in These Digits” field. This is where you will set up your A/B Test.

Using Order IDs to divide your orders

Next, divide up your orders based off the numbers contained in your customer’s Order IDs. For example, in Message A you would enter in 12345 and that message would only be sent to orders ending in those digits. Conversely, in Message B you would enter in the remaining numbers which would be would be orders ending in 67890. 

You can also divide up your orders by even or odd numbers. For example, Message A could be sent to orders ending in even numbers 24680 and Message B could then be sent to orders ending in odd numbers 13579.

Note: While you do not need spaces or commas between these numbers, they do represent the single ending digit of the order ID, and not the last five.

Begin your test 

Once you divide your messages and order numbers, you can click "Done" on each message to begin the A/B test. Depending on how many orders you send messages for, you'll need to wait at least two weeks to collect enough data. 

Check your Message Analytics for both messages to see which message yielded higher open rates. Give the A/B test at least a month to get a clearer idea of your message’s performance. 

Wrap up
Implement what you've learned into your top-performing message and repeat the process to improve your messages' effectiveness. 


Need help? Our support team is happy to assist you! 🙂

  • Connect via the in-app chat icon, located in the bottom-right of your screen while logged into any of our apps
  • Search the Knowledge Base to see if your question has already been answered
  • Make an appointment with us for more direct support
  • Call our support line at (404) 909-8251 between 9 a.m. and 5 p.m. Eastern Time, Monday through Friday

Did this answer your question?