Skip to content
vitest-evals

JudgeAssertionOptions

JudgeAssertionOptions<TJudgeOptions> = JudgeAssertionParams<TJudgeOptions> & object

Optional overrides passed to expect(...).toSatisfyJudge(...).

Type Declaration

Section titled “Type Declaration”

harness?

Section titled “harness?”

optional harness?: JudgeAssertionHarness<TJudgeOptions>

Override or provide the harness associated with the judge context.

input?

Section titled “input?”

optional input?: JudgeAssertionInput<TJudgeOptions>

Override or provide the original eval input for the judge.

judgeHarness?

Section titled “judgeHarness?”

optional judgeHarness?: JudgeHarness

Override or provide the judge harness for judges that call ctx.runJudge(...).

metadata?

Section titled “metadata?”

optional metadata?: JudgeAssertionMetadata<TJudgeOptions>

Override or provide per-run judge metadata.

output?

Section titled “output?”

optional output?: JudgeAssertionOutput<TJudgeOptions>

Override or provide the app-facing output for the judge.

run?

Section titled “run?”

optional run?: HarnessRun<JudgeAssertionOutput<TJudgeOptions>>

Override or provide the complete normalized harness run.

session?

Section titled “session?”

optional session?: HarnessRun["session"]

Override or provide the normalized session transcript.

threshold?

Section titled “threshold?”

optional threshold?: number | null

Passing threshold for the explicit matcher. null records the score without failing.

toolCalls?

Section titled “toolCalls?”

optional toolCalls?: ToolCallRecord[]

Override or provide flattened tool calls for the judge.

Type Parameters

Section titled “Type Parameters”

TJudgeOptions

Section titled “TJudgeOptions”

TJudgeOptions extends JudgeContext<any, any, any, any> = JudgeContext

Example

Section titled “Example”
await expect(result).toSatisfyJudge(RefundStatusJudge, {
  threshold: null,
});