What Is A/B Testing?
A/B testing is a simple way to improve cold email using data, not guesses.
You create two versions of the same email:
- Version A goes to one part of your list
- Version B goes to the other part
Then you compare results and keep what performs better.
Goal
Improve performance step by step with proof.
The golden rule of A/B testing
Test one variable only.
If you change two things at once, you will not know what caused the result.
Keep everything the same and change only one item.
What to test
Pick what to test based on what you want to improve.
1) Subject line
Best for improving open rate
Example
Version A: Quick question for {{company}}
Version B: Partnership?
Keep the winner.
2) Offer
Best for improving reply rate
If opens are good but replies are low, your offer is usually the issue.
Example
Version A: We help you get more leads using SEO
Version B: We guarantee 10 qualified leads per month or you do not pay
3) Call to action
Best for improving ease of reply
Example
Version A: Can we book a 15 minute call on Tuesday
Version B: Are you taking on new clients right now
Lower friction usually wins.
How to run an A/B test
Most sequencers support variants, including Smartlead, Instantly, and Saleshandy.
Steps
- Write Version A
- Create Version B
- Change one variable only
- Split sends evenly across both versions
- Wait until you have enough results
- Pick a winner and roll it out
Sample size rule
Do not decide from 10 emails.
A practical baseline is:
- 300 to 500 sends per version before choosing a winner
Small early differences are often just luck.
A simple winning order
- Test subject line first to lift opens
- Lock the best subject line
- Test the offer next to lift replies
- Test the call to action to increase responses
In summary
A/B testing is how you turn a weak campaign into a strong one with clear evidence.
Change one thing, measure results, keep the winner, and repeat.
Powered by