Skip to main content

Overview

Compare Profiles lets you compare two or three customer profiles, or a parent profile with one to three of its active variants. Both modes use the same performance metrics and lead activity to show how profiles perform with similar leads.
Compare Profiles is read-only. It helps you evaluate profile performance but does not change profile instructions, traffic allocation, or follow-up settings.

Compare profiles

  1. Go to Optimize > Compare Profiles.
  2. Select two or three customer profiles.
  3. Choose a comparison goal:
    • Voice Transfer Rate: higher is better.
    • Hot Lead Rate: higher is better.
    • All-Channel Opt-Out Rate: lower is better.
  4. Review the current results, traffic split, and six-week trend for each profile.
The comparison marks a profile as the winner so far when there is enough imported lead activity to compare at least two profiles. If there is not enough activity, continue collecting results before drawing a conclusion.

A/B testing

Use Compare Profiles to evaluate profile variants during an A/B test:
  • Keep the profiles focused on the same type of lead or business goal.
  • Compare profiles with similar amounts of imported lead traffic.
  • Choose a success metric before reviewing the results.
  • Use the six-week trend to check whether a result is consistent over time.
  • Review the profile instructions and conversation examples before making a change.
Avoid treating a profile as the winner when it has little or no imported lead activity. A higher rate from a small sample may not represent a reliable difference.

Compare profile variants

Use Variants mode to compare a parent profile with its active variants:
  1. Go to Optimize > Compare Profiles and choose Variants.
  2. Select a parent profile; it is included automatically. Choose one to three of its active variants to compare with it.
  3. Choose a comparison goal:
    • Voice Transfer Rate: higher is better.
    • Hot Lead Rate: higher is better.
    • All-Channel Opt-Out Rate: lower is better.
  4. Review the results, traffic split, and six-week trend for the parent profile and selected variants.
Create variants and set their import weights in the profile’s Variants tab under Build & Test. Retired variants can be restored from that tab. Comparisons are read-only; they do not change import weights. Only leads assigned to each selected profile contribute to its results.

Available metrics

The comparison includes:
  • Leads imported
  • Positive engagement and hot lead rates
  • Voice transfer rate
  • SMS, voice, and email engagement
  • All-channel, SMS, voice, and email opt-out rates
  • Traffic split across the selected profiles