vitest-evals
Interfaces
Section titled “Interfaces”- BaseMatcherConfig
- DescribeEvalOptions
- EvalMatchers
- EvalTestContext
- FuzzyMatchOptions
- Judge
- JudgeContext
- StructuredOutputJudgeConfig
- StructuredOutputJudgeOptions
- ToolCallJudgeConfig
- ToolCallJudgeOptions
Type Aliases
Section titled “Type Aliases”BoundJudgeAssessor- CreateHarnessOptions
- CreateHarnessRunArgs
- CreateJudgeHarnessOptions
- CreateJudgeHarnessRunOptions
- EnsureRunTraceOptions
- EvalHarnessRun
- EvalRun
- EvalTestAPI
- FactualityJudgeChoice
- FactualityJudgeConfig
- FactualityJudgeExpected
- FactualityJudgeOptions
- FactualityJudgePrompt
- FactualityJudgeVerdict
- GenAiOperationName
- GenAiOutputType
- GenAiProviderName
- GenAiSemanticAttributeKey
- GenAiSemanticAttributes
- GenAiTokenType
- GenAiToolType
- Harness
- HarnessContext
- HarnessMetadata
- HarnessResultLike
- HarnessRun
- HarnessRunError
- JsonPrimitive
- JsonValue
- JudgeAssertionOptions
- JudgeAssessFn
JudgeAssessorJudgeAssessorOptionsJudgeAssessWithAssessorFn- JudgeHarness
- JudgeHarnessInput
- JudgeHarnessOutput
- JudgeOptions
- JudgeResult
- MatchStrategy
- MaybePromise
- NormalizedSession
- NormalizedSpan
- NormalizedSpanAttributeKey
- NormalizedSpanAttributes
- NormalizedSpanEvent
- NormalizedTrace
- OpenTelemetrySemanticAttributeKey
- OpenTelemetrySemanticAttributes
- RunJudge
- RunJudgeOptions
- SimpleHarnessResult
- SimpleSpanEvent
- SimpleSpanRecord
- SimpleTraceRecord
- SimpleTranscriptInput
- StructuredOutputJudgeExpected
- TimingSummary
- ToolCall
- ToolCallJudgeExpectedTool
- ToSatisfyJudge
- TranscriptEvent
- TranscriptMessageContentPart
- TranscriptMessageEvent
- TranscriptMessageInput
- TranscriptMessageTextPart
- TranscriptMessageToolCall
- TranscriptMessageToolCallPart
- TranscriptMessageToolResultPart
- TranscriptToolCallEvent
- TranscriptToolResultEvent
- UsageSummary
Functions
Section titled “Functions”- assistantMessages
- attachHarnessRunToError
- createFailedHarnessRun
- createGenAiUsageAttributes
- createHarness
- createJudge
- createJudgeHarness
- describeEval
- ensureRunTrace
- FactualityJudge
- failedSpans
- formatScores
- getHarnessRunFromError
- latestAssistantMessageContent
- messagesByRole
- messagesToTranscriptEvents
- normalizeHarnessRun
- normalizeSpanAttributes
- normalizeSpanError
- runJudgeHarness
- spans
- spansByKind
- StructuredOutputJudge
- systemMessages
- toJsonValue
- ToolCallJudge
- toolCalls
- toolMessages
- userMessages
- wrapText