Introduction

The Giskard Hub Python SDK (giskard-hub) gives you programmatic access to everything the Hub can do: define agents, build evaluation datasets, run evaluations and vulnerability scans, schedule recurring runs, and manage your entire quality workflow from code.

pip install giskard-hub

from giskard_hub import HubClient

hub = HubClient()  # reads GISKARD_HUB_BASE_URL and GISKARD_HUB_API_KEY from env

project = hub.projects.list()[0]
evaluation = hub.evaluations.create(
    agent_id="<agent-id>",
    dataset_id="<dataset-id>",
    project_id=project.id,
    name="My first evaluation",
)

Where to start

Quickstart Install the SDK, set up authentication, and run your first evaluation in minutes.

Core Concepts Understand how Projects, Agents, Datasets, Evaluations, and Scans fit together.

How-to Guides Step-by-step guides for every feature: datasets, evaluations, scans, scheduling, and more.

API Reference Full reference for every resource, method, and type exported by the SDK.

Key capabilities

• Evaluate — run your agent against datasets of scenarios with configurable checks (LLM judge, embedding similarity, rule-based, etc.)
• Scan — automated red-teaming covering the OWASP LLM Top 10 and additional threat categories
• Generate — auto-generate scenarios from prompt presets or knowledge bases, or promote playground conversations into datasets
• Schedule — set up recurring evaluations (daily, weekly, monthly) for continuous quality monitoring
• Track — create tasks from failed results, annotate scenarios with comments, and audit every change

Migrating from Hub v2?

If you used the SDK to interact with the Hub v2, you can use the same SDK to interact with the Hub v3, with little changes. See the Migration Guide for a complete list of breaking changes and before/after code examples.

Need help?

• Documentation: Browse the How-to Guides for step-by-step walkthroughs of every feature
• Examples: Check our GitHub repository for runnable examples and notebooks
• Community: Join our Discord for support and discussions
• Enterprise: Need on-premise deployment or dedicated support? Contact us