vigiles API reference
    Preparing search index...

    Function runEval

    • Run the eval: every arm × every trial against the real claude CLI, with the metric computed per run and aggregated per arm. Requires claude on PATH and working model auth (e.g. ANTHROPIC_API_KEY). Thin wrapper over runEvalWith with the real agent runner.

      Type Parameters

      Parameters

      Returns Promise<EvalReport>