How to A/B Test Email Subject Lines in Vedain CRM

Setting Up an A/B Test

1. In the Campaign Builder, after selecting your template and recipients, enable the A/B Test toggle.
2. Enter Subject Line A (your original idea).
3. Enter Subject Line B (your alternative — change one thing only).
4. Set the Test Split: e.g., 50/50 sends equal portions; 20/80 sends 20% as the test group and holds 80% for the winner.
5. Set the Winner Criteria: Open Rate (more opens = better subject) or Click Rate (more clicks = better engagement).
6. Set the Evaluation Period: how many hours to wait before picking a winner (e.g., 4 hours).
7. Click Send.

What Happens Automatically

1. Group A receives Subject Line A.
2. Group B receives Subject Line B.
3. After the evaluation period, Vedain compares open rates (or click rates) for A vs B.
4. The winning subject line is sent to the remaining recipients automatically.
5. You can see A vs B performance on the Campaign Detail page.

Subject Line A/B Test Best Practices

• •Change only one variable: If you change the subject line AND the preview text, you won't know which change caused the difference.
• •Use a meaningful sample size: A/B tests need at least 200 recipients per variant to be statistically meaningful.
• •Test clear hypotheses: 'Does adding the company name improve opens?' or 'Does a question outperform a statement?'
• •Common tests that work: question vs statement, personalised ({{firstName}}) vs generic, short vs long, with emoji vs without.