Overview
Business vulnerabilities are failures that affect the business logic, accuracy, and reliability of AI systems. These include issues that impact the model’s ability to provide accurate, reliable, and appropriate responses in normal usage scenarios.
Understanding Business Failures
Section titled “Understanding Business Failures”Business vulnerabilities differ from security vulnerabilities in that they focus on the model’s ability to provide correct and grounded responses with respect to a knowledge base taken as ground truth. These failures can occur in Retrieval-Augmented Generation (RAG) systems and other AI applications where accuracy and reliability are critical for business operations.
Types of Business Failures
Section titled “Types of Business Failures” Addition of Information The AI incorrectly adds information that was not present in the context of the groundedness check.
Business Out of Scope The AI provides answers about products or services outside their defined business scope.
Denial of Answers The AI incorrectly refuses to answer legitimate questions that are in scope.
Hallucinations The AI generates information not present in your knowledge base.
Moderation Issues The AI incorrectly provides the wrong default moderation answer.
Omission The AI incorrectly omits information that is present in the reference context.
Getting Started with Business Testing
Section titled “Getting Started with Business Testing”To begin testing your AI systems for business failures:
Giskard Hub UI Business Dataset Our state-of-the-art enterprise-grade business failure testing.