Assert arm significantly beats baseline on metric (positive gap, p < α).
The statistical gate for a non-deterministic A/B — "the gap clears the noise",
with the noise floor computed, not supplied. The honest version of
assertImproves(..., { by: se }).
Assert
armsignificantly beatsbaselineonmetric(positive gap, p < α). The statistical gate for a non-deterministic A/B — "the gap clears the noise", with the noise floor computed, not supplied. The honest version ofassertImproves(..., { by: se }).