Experiments
Experiments lets you A/B test a change before you commit to it. Run a challenger — a different evidence configuration or rebuttal letter — against your current champion on a share of live disputes, and let the results decide.
Setting up an experiment
Section titled “Setting up an experiment”Admins create an experiment by choosing:
- the scope — a brand (or all brands), a reason category, and a processor (or all processors),
- the challenger share — what fraction of matching live disputes get the challenger,
- and the challenger itself — an evidence-type selection and/or a rebuttal letter template.
The rest keep using your champion, so you’re always comparing like for like.
Reading the results
Section titled “Reading the results”Each experiment card shows champion vs challenger win rate, the probability the challenger beats the champion, the expected lift, the value you’re giving up while testing, and the estimated days to confidence.
Deciding
Section titled “Deciding”When you’re ready, admins can:
- Promote challenger — make it your new champion,
- Keep champion — end the test, no change,
- Stop — end an experiment that’s inconclusive or clearly worse,
- or Delete a draft you never started.