Skip to content
vitest-evals

JudgeHarnessInput

JudgeHarnessInput = object

Provider-neutral prompt request issued by an LLM-backed judge.

Example

Section titled “Example”
const input: JudgeHarnessInput = {
  system: "Grade factual consistency.",
  prompt: "Compare the submitted answer with the reference answer.",
  responseFormat: {
    type: "json",
  },
};

Properties

Section titled “Properties”

prompt

Section titled “prompt”

prompt: string

User prompt or instruction payload for the judge model.

responseFormat?

Section titled “responseFormat?”

optional responseFormat?: object

Optional response-format hint for adapters that support structured output.

schema?

Section titled “schema?”

optional schema?: JsonValue

Optional JSON Schema passed through to provider-specific adapters.

type

Section titled “type”

type: "json"

Requests a JSON-compatible response.

system?

Section titled “system?”

optional system?: string

Optional system prompt for the judge model.