vigiles API reference
    Preparing search index...

    Interface MetricStat

    Per-metric summary statistics across an arm's runs.

    interface MetricStat {
        mean: number;
        n: number;
        passK: number;
        se: number;
        std: number;
    }
    Index

    Properties

    Properties

    mean: number

    Mean (numbers) / fraction-true (booleans).

    n: number

    Number of runs the metric was observed in.

    passK: number

    pass^k (τ-bench): 1 if the metric succeeded on EVERY trial, else 0. The reliability question a non-deterministic harness needs — "worked every time" is not "worked on average". A trial counts as a success when its value is truthy (booleans true, counts > 0), so model your metric as success/fail.

    se: number

    Standard error of the mean (std / √n).

    std: number

    Sample standard deviation (0 when n < 2).