Hide navigation sidebar

Hide table of contents sidebar

Hide search

Toggle site navigation sidebar

Toggle search

Hide search

Getting Started

Why Giskard?
Quickstart
Toggle navigation of Quickstart

Guides

📥 Install the Giskard Python Library
🤖 Setting up the LLM Client
🔍 Scan a model
Toggle navigation of 🔍 Scan a model
🧰 RAG Evaluation Toolkit
Toggle navigation of 🧰 RAG Evaluation Toolkit
- 🎯 RAGET Testset Generation
- 🥇 RAGET Evaluation
🧪 Customize your tests
Toggle navigation of 🧪 Customize your tests
🔁 Integrate your tests
Toggle navigation of 🔁 Integrate your tests
- 🚀 Execute your test suite in your CI/CD pipeline
- 🏃 MLflow
  Toggle navigation of 🏃 MLflow
  - MLflow Example - LLM - Databricks
  - MLFlow Example - Tabular
- 🐝 Weights & Biases
  Toggle navigation of 🐝 Weights & Biases
  - W&B Example - LLM
  - W&B Example - Tabular
- 🧪 Pytest
  Toggle navigation of 🧪 Pytest
  - Example script

Notebook Tutorials

LLM Tutorials
Toggle navigation of LLM Tutorials
RAG Tutorials
Toggle navigation of RAG Tutorials
- RAG Evaluation Toolkit on an IPCC Climate Agent
Tabular Tutorials
Toggle navigation of Tabular Tutorials
NLP Tutorials
Toggle navigation of NLP Tutorials

Knowledge

LLM Vulnerabilities
How does the LLM Scan work?
ML Model Vulnerabilities
Toggle navigation of ML Model Vulnerabilities
Catalogs
Toggle navigation of Catalogs
- Tests
  Toggle navigation of Tests
- Slicing functions
- Transformation functions

Integrations

🐙️ GitHub
Toggle navigation of 🐙️ GitHub
- 🚀 Execute your test suite in your CI/CD pipeline
🏃 MLflow
Toggle navigation of 🏃 MLflow
- MLflow Example - LLM - Databricks
- MLFlow Example - Tabular
🐝 Weights & Biases
Toggle navigation of 🐝 Weights & Biases
- W&B Example - LLM
- W&B Example - Tabular
🐶 DagsHub
🤗 Hugging Face
Toggle navigation of 🤗 Hugging Face
- 🐢Giskard Hub
- 🔍Giskard Evaluator
📒 AVID
Toggle navigation of 📒 AVID
- Reporting Giskard LLM Scans to AVID
🧪 Pytest
Toggle navigation of 🧪 Pytest
- Example script

API Reference

Command-line interface
Toggle navigation of Command-line interface
- Setup a ngrok account
Models
Toggle navigation of Models
Dataset
Model Scanner
Toggle navigation of Model Scanner
RAG Evaluation Toolkit
Toggle navigation of RAG Evaluation Toolkit
Tests
Toggle navigation of Tests
Slicing functions
Transformation functions
Automated model insights
Test suite

Community

Discord community
GitHub community
Contribute to Giskard
Toggle navigation of Contribute to Giskard

v: latest

Versions: latest; stable; v2.10.0; gsk-2892-rework-question-generation

Downloads

On Read the Docs: Project Home; Builds

Toggle table of contents sidebar

Testset Generation¶

RAG Evaluation Toolkit

Copyright © 2024, Giskard AI

Made with Sphinx and @pradyunsg's Furo