Skip to main content

Overview

Compare Profiles lets you compare two or three customer profiles using the same performance metrics and lead activity. Use it as an A/B testing view to understand which profile is performing better with similar leads.
Compare Profiles is read-only. It helps you evaluate profile performance but does not change profile instructions, traffic allocation, or follow-up settings.

Compare profiles

  1. Go to Optimize > Compare Profiles.
  2. Select two or three customer profiles.
  3. Choose a comparison goal:
    • Voice Transfer Rate: higher is better.
    • Hot Lead Rate: higher is better.
    • All-Channel Opt-Out Rate: lower is better.
  4. Review the current results, traffic split, and six-week trend for each profile.
The comparison marks a profile as the winner so far when there is enough imported lead activity to compare at least two profiles. If there is not enough activity, continue collecting results before drawing a conclusion.

A/B testing

Use Compare Profiles to evaluate profile variants during an A/B test:
  • Keep the profiles focused on the same type of lead or business goal.
  • Compare profiles with similar amounts of imported lead traffic.
  • Choose a success metric before reviewing the results.
  • Use the six-week trend to check whether a result is consistent over time.
  • Review the profile instructions and conversation examples before making a change.
Avoid treating a profile as the winner when it has little or no imported lead activity. A higher rate from a small sample may not represent a reliable difference.

Available metrics

The comparison includes:
  • Leads imported
  • Positive engagement and hot lead rates
  • Voice transfer rate
  • SMS, voice, and email engagement
  • All-channel, SMS, voice, and email opt-out rates
  • Traffic split across the selected profiles