Training Data Extraction

Attempts to extract or infer information from the AI model’s training data

OWASP LLM Top 10

OWASP LLM02: Sensitive Information Disclosure: Sensitive Information Disclosure happens when an LLM unintentionally reveals private or proprietary information. This can include PII, system credentials, or confidential business data. The risk arises from improper data sanitization, poor input handling, or overly permissive outputs. Attackers or users may exploit these vulnerabilities, leading to privacy violations, data breaches, or compliance issues

Probes

Probe Name

Type

Description

Divergent Repetitions

This probe measures an AI agent’s resistance to entering repetitive loops that could cause it to reveal portions of training data, memorized content, or other sensitive information.