vigiles API reference
    Preparing search index...

    Function compareArms

    • Compare two arms on a metric using their reported summary stats, or null if either arm/metric is absent. The grounded form of assertImproves's by: it computes the noise floor instead of asking the caller to supply it.

      Parameters

      • report: EvalReport
      • baseline: string
      • arm: string
      • metric: string
      • alpha: number = 0.05

      Returns Comparison | null