JudgeHarness

JudgeHarness = Harness<JudgeHarnessInput, JudgeHarnessOutput, HarnessMetadata>

Harness used by LLM-backed judges to issue judge-side prompts.

This is separate from the application harness under test.

Example

const judgeHarness: JudgeHarness = createJudgeHarness({
  name: "judge-model",
  run: async ({ prompt }, { signal }) => {
    return callJudgeModel({ prompt, signal });
  },
});