vigiles API reference
    Preparing search index...

    Function reliable

    • Did arm succeed on EVERY trial for metric — τ-bench pass^k = 1? The reliability predicate over an eval report (vs. improvement, which reads the mean gap). Reads report.arms[arm].stats[metric].passK.

      Parameters

      Returns boolean