CreateJudgeHarnessOptions

CreateJudgeHarnessOptions = object

Configuration for createJudgeHarness(...).

Example

const judgeHarness = createJudgeHarness({
  name: "custom-judge",
  run: async ({ system, prompt }, { signal }) => {
    return callProvider({ system, prompt, signal });
  },
});

Properties

name?

optional name?: string

Stable harness name used in diagnostics.

---

run

run: (input, options) => MaybePromise<unknown>

Runs one provider-specific judge prompt.

Return a JSON-safe value, a raw provider value to normalize, a lightweight { output } result, or a full normalized HarnessRun.

Parameters

input

JudgeHarnessInput

options

CreateJudgeHarnessRunOptions

Returns

MaybePromise<unknown>