Skip to content

EvalRun

EvalRun<TInput, TOutput, TMetadata, THarness> = (input, options?) => Promise<EvalHarnessRun<TInput, TOutput, TMetadata, THarness>>

Explicit harness execution primitive exposed to each eval test.

TInput = unknown

TOutput extends JsonValue | undefined = JsonValue | undefined

TMetadata extends HarnessMetadata = HarnessMetadata

THarness extends Harness<TInput, TOutput, TMetadata> = Harness<TInput, TOutput, TMetadata>

TInput

EvalRunOptions<TMetadata>

Promise<EvalHarnessRun<TInput, TOutput, TMetadata, THarness>>

const result = await run("Refund invoice inv_123", {
metadata: { expected: { status: "approved" } },
});