Summarize a binary online experiment with a primary rate, practical lift, and a ship-or-hold decision.
Required APIdef ab_test_summary(control, treatment, min_lift):
return {'control_rate': ..., 'treatment_rate': ..., 'lift': ..., 'decision': ...}Think through the mechanism first if you want the extra reasoning step. It never blocks the editor.
ab_test_summary([1, 0, 1, 1], [1, 1, 1, 1], 0.1)a practical improvement can earn rollout
ab_test_summary([1, 1], [1, 1], 0.1)no improvement does not justify a change
2 hidden edge tests run after the visible contract passes.
Run Tests to see the contract verdicts here.