Hide navigation sidebar

Hide table of contents sidebar

Hide search

Toggle site navigation sidebar

Toggle search

Hide search

Getting Started

Guides

📥 Install the Giskard Python Library
🤖 Setting up the LLM Client
🔍 Scan a model
Toggle navigation of 🔍 Scan a model
🧰 RAG Evaluation Toolkit
Toggle navigation of 🧰 RAG Evaluation Toolkit
- 🎯 RAGET Testset Generation
- 🥇 RAGET Evaluation
🧪 Customize your tests
Toggle navigation of 🧪 Customize your tests
🔁 Integrate your tests
Toggle navigation of 🔁 Integrate your tests
- 🚀 Execute your test suite in your CI/CD pipeline
- 🏃 MLflow
  Toggle navigation of 🏃 MLflow
  - MLflow Example - LLM - Databricks
  - MLFlow Example - Tabular
- 🐝 Weights & Biases
  Toggle navigation of 🐝 Weights & Biases
  - W&B Example - LLM
  - W&B Example - Tabular
- 🧪 Pytest
  Toggle navigation of 🧪 Pytest
  - Example script

Notebook Tutorials

LLM Tutorials
Toggle navigation of LLM Tutorials
RAG Tutorials
Toggle navigation of RAG Tutorials
- RAG Evaluation Toolkit on an IPCC Climate Agent
Tabular Tutorials
Toggle navigation of Tabular Tutorials
NLP Tutorials
Toggle navigation of NLP Tutorials

Knowledge

Integrations

🐙️ GitHub
Toggle navigation of 🐙️ GitHub
- 🚀 Execute your test suite in your CI/CD pipeline
🏃 MLflow
Toggle navigation of 🏃 MLflow
- MLflow Example - LLM - Databricks
- MLFlow Example - Tabular
🐝 Weights & Biases
Toggle navigation of 🐝 Weights & Biases
- W&B Example - LLM
- W&B Example - Tabular
🐶 DagsHub
🤗 Hugging Face
Toggle navigation of 🤗 Hugging Face
- 🐢Giskard Hub
- 🔍Giskard Evaluator
📒 AVID
Toggle navigation of 📒 AVID
- Reporting Giskard LLM Scans to AVID
🧪 Pytest
Toggle navigation of 🧪 Pytest
- Example script

API Reference

Command-line interface
Toggle navigation of Command-line interface
- Setup a ngrok account
Models
Toggle navigation of Models
Dataset
Model Scanner
Toggle navigation of Model Scanner
RAG Evaluation Toolkit
Toggle navigation of RAG Evaluation Toolkit
Tests
Toggle navigation of Tests
Slicing functions
Transformation functions
Automated model insights
Test suite

Community

v: latest

Toggle table of contents sidebar

🧰 RAG Evaluation Toolkit¶

Made with Sphinx and @pradyunsg's Furo