Hide navigation sidebar

Hide table of contents sidebar

Hide search

Toggle site navigation sidebar

Toggle search

Hide search

Getting Started

Why Giskard?
Quickstart
Toggle navigation of Quickstart

Guides

📥 Install the Giskard Python Library
🤖 Setting up the LLM Client
🔍 Scan a model
Toggle navigation of 🔍 Scan a model
🧰 RAG Evaluation Toolkit
Toggle navigation of 🧰 RAG Evaluation Toolkit
- 🎯 RAGET Testset Generation
- 🥇 RAGET Evaluation
🧪 Customize your tests
Toggle navigation of 🧪 Customize your tests
🔁 Integrate your tests
Toggle navigation of 🔁 Integrate your tests
- 🚀 Execute your test suite in your CI/CD pipeline
- 🏃 MLflow
  Toggle navigation of 🏃 MLflow
  - MLflow Example - LLM - Databricks
  - MLFlow Example - Tabular
- 🐝 Weights & Biases
  Toggle navigation of 🐝 Weights & Biases
  - W&B Example - LLM
  - W&B Example - Tabular
- 🧪 Pytest
  Toggle navigation of 🧪 Pytest
  - Example script

Notebook Tutorials

LLM Tutorials
Toggle navigation of LLM Tutorials
RAG Tutorials
Toggle navigation of RAG Tutorials
- RAG Evaluation Toolkit on an IPCC Climate Agent
Tabular Tutorials
Toggle navigation of Tabular Tutorials
NLP Tutorials
Toggle navigation of NLP Tutorials
Vision Tutorials
Toggle navigation of Vision Tutorials
- Face landmark detection
- Object detection

Knowledge

LLM Vulnerabilities
How does the LLM Scan work?
ML Model Vulnerabilities
Toggle navigation of ML Model Vulnerabilities
Catalogs
Toggle navigation of Catalogs
- Tests
  Toggle navigation of Tests
- Slicing functions
- Transformation functions

Integrations

🐙️ GitHub
Toggle navigation of 🐙️ GitHub
- 🚀 Execute your test suite in your CI/CD pipeline
🏃 MLflow
Toggle navigation of 🏃 MLflow
- MLflow Example - LLM - Databricks
- MLFlow Example - Tabular
🟩 NeMo Guardrails
Toggle navigation of 🟩 NeMo Guardrails
- NeMo Guardrails + Giskard scan
🐝 Weights & Biases
Toggle navigation of 🐝 Weights & Biases
- W&B Example - LLM
- W&B Example - Tabular
🐶 DagsHub
🤗 Hugging Face
Toggle navigation of 🤗 Hugging Face
- 🔍Giskard Evaluator
📒 AVID
Toggle navigation of 📒 AVID
- Reporting Giskard LLM Scans to AVID
🧪 Pytest
Toggle navigation of 🧪 Pytest
- Example script

API Reference

Models
Toggle navigation of Models
Dataset
Model Scanner
Toggle navigation of Model Scanner
RAG Evaluation Toolkit
Toggle navigation of RAG Evaluation Toolkit
Tests
Toggle navigation of Tests
Slicing functions
Transformation functions
Automated model insights
Test suite

Community

Discord community
GitHub community
Contribute to Giskard
Toggle navigation of Contribute to Giskard

Toggle table of contents sidebar

Knowledge Base¶

Testset Generation

Copyright © 2024, Giskard AI

Made with Sphinx and @pradyunsg's Furo