vitest-evals
Interfaces
Section titled “Interfaces”- BaseMatcherConfig
- DescribeEvalOptions
- EvalMatchers
- EvalRunOptions
- EvalTestContext
- FuzzyMatchOptions
- Judge
- JudgeContext
- StructuredOutputJudgeConfig
- StructuredOutputJudgeOptions
- ToolCallJudgeConfig
- ToolCallJudgeOptions
Type Aliases
Section titled “Type Aliases”BoundJudgeAssessor- CreateHarnessOptions
- CreateHarnessRunArgs
- CreateJudgeHarnessOptions
- CreateJudgeHarnessRunOptions
- EvalHarnessRun
- EvalRun
- EvalTestAPI
- FactualityJudgeChoice
- FactualityJudgeConfig
- FactualityJudgeExpected
- FactualityJudgeOptions
- FactualityJudgePrompt
- FactualityJudgeVerdict
- Harness
- HarnessContext
- HarnessMetadata
- HarnessResultLike
- HarnessRun
- HarnessRunError
- JsonPrimitive
- JsonValue
- JudgeAssertionOptions
- JudgeAssessFn
JudgeAssessorJudgeAssessorOptionsJudgeAssessWithAssessorFn- JudgeHarness
- JudgeHarnessInput
- JudgeHarnessOutput
- JudgeOptions
- JudgeResult
- MatchStrategy
- MaybePromise
- NormalizedMessage
- NormalizedSession
- RunJudge
- RunJudgeOptions
- SimpleHarnessResult
- SimpleToolCallRecord
- StructuredOutputJudgeExpected
- TimingSummary
- ToolCallJudgeExpectedTool
- ToolCallRecord
- ToSatisfyJudge
- UsageSummary
Functions
Section titled “Functions”- assistantMessages
- attachHarnessRunToError
- createHarness
- createJudge
- createJudgeHarness
- describeEval
- FactualityJudge
- formatScores
- getHarnessRunFromError
- latestAssistantMessageContent
- messagesByRole
- normalizeHarnessRun
- runJudgeHarness
- StructuredOutputJudge
- systemMessages
- ToolCallJudge
- toolCalls
- toolMessages
- userMessages
- wrapText