vigiles API reference
    Preparing search index...

    Function significantlyBeats

    • Did arm significantly beat baseline on metric — a positive gap whose two-sided Welch t-test p-value is below alpha (default 0.05)? The grounded upgrade over improvement: the noise floor is computed from the arms' spread, not hand-fed. False when either arm/metric is missing. See src/stats.ts.

      Parameters

      • report: EvalReport
      • baseline: string
      • arm: string
      • metric: string
      • alpha: number = 0.05

      Returns boolean