Evals/Experiments

Experiments

A/B test prompt versions to find the best performers

How A/B Testing Works

  1. 1.Choose a control prompt (your current version) and a variant (new version to test)
  2. 2.Set traffic split (e.g., 50/50) to route executions between versions
  3. 3.Collect feedback on outputs from both versions
  4. 4.When statistical significance is reached, we'll recommend a winner