πŸ“’ AVID#

What is AVID?#

The AI Vulnerability Database (AVID) is an open-source knowledge base focused on documenting the failure modes of AI models, datasets, and systems.

The AVID project has two focus areas:

  • a Taxonomy of failure modes of AI systems across the categories of security, ethics, and performance

  • a Database of reports about such failures, containing detailed and structured information about each failure event

Find out more on https://avidml.org.

Why integrating with Giskard?#

The Giskard scan is a powerful tool to detect vulnerabilities in your AI models, from traditional ML to LLMs. Its integration with AVID taxonomy provides improved standardized reporting of vulnerabilities, and the ability to share your vulnerability reports with the community.

AVID taxonomy in the Giskard scan report#

By default, all Giskard scan reports indicate the AVID taxonomy categories that are relevant to the detected vulnerabilities. You can find this information in the detail view of each issue in the scan widget:

avid

Exporting AVID reports from the Giskard scan#

You can export your Giskard scan report as an AVID report. First, make sure you have installed the avidtools package in your environment:

pip install avidtools

Then, once you have run the Giskard scan, you can export the report as an AVID report:

import giskard as gsk

scan_report = gsk.scan(my_model, my_dataset)

# Export the report as a list of AVID reports (one per each vulnerability)
avid_reports = scan_report.to_avid()

You can also export these reports directly in a JSONL file (one AVID report per line):


# Write the AVID reports to a JSONL file
scan_report.to_avid("avid_report.jsonl")

Tutorials#