Giskard Checks API Reference

These pages document the symbols in giskard.checks you will use directly. They assume you have written a test already. If you have not, start with Your First Test; the terms used here (scenario, check, trace, judge) are introduced in Core Concepts.

API modules

Core Base classes and fundamental types: Check, Trace, Interaction, Scenario, TestCase

Checks Ready-to-use validation checks: string matching, comparisons, RegoPolicy, composition, LLM judges

Scenarios Multi-step workflow testing with scenario builders and runners

Testing Utilities Testing utilities: test runners, spies, and debugging helpers

Generators Input generators for creating dynamic test data and scenarios

Utilities Helper functions for normalization, value providers, and parameter injection

Settings Default LLM generator, embedding model, and environment-backed GiskardChecksSettings

Quick reference

from giskard.checks import (
    # Core types
    Check,
    CheckResult,
    CheckStatus,
    Interaction,
    InteractionSpec,
    Trace,
    Scenario,
    TestCase,
    Suite,
    SuiteResult,
    # Built-in checks
    FnCheck,
    StringMatching,
    RegexMatching,
    JsonValid,
    Readability,
    SemanticSimilarity,
    Equals,
    NotEquals,
    LessThan,
    LessThanEquals,
    GreaterThan,
    GreaterThanEquals,
    AllOf,
    AnyOf,
    Not,
    RegoPolicy,
    # Configuration
    set_default_generator,
    get_default_generator,
)

# LLM-based checks
from giskard.checks import (
    BaseLLMCheck,
    LLMCheckResult,
    Groundedness,
    AnswerRelevance,
    Toxicity,
    Conformity,
    Contradiction,
    LLMJudge,
)

# Generators
from giskard.checks import LLMGenerator, DatasetInputGenerator, UserSimulator

# Suite generation lives in the scan package, not in giskard.checks
from giskard.scan import generate_suite