Skip to content

JudgeAssessor

JudgeAssessor<TInput, TOutput> = object

Legacy provider/model helper that a judge can use without running the app harness.

New LLM-backed judges should use createJudgeHarness(...) plus ctx.runJudge(...) instead. The judge harness path supports response formats, matcher/suite/judge-level configuration, and keeps provider adapters outside core judge implementations.

const assessor: JudgeAssessor<string, { passed: boolean; rationale: string }> = {
assess: async (prompt, { signal }) => runRubricModel(prompt, { signal }),
};

TInput = string

TOutput = string

assess: (input, options) => Promise<TOutput> | TOutput

Runs the judge-side model/provider call.

TInput

JudgeAssessorOptions

Promise<TOutput> | TOutput