Setup API keys, projects, agents and knowledge bases

In this section, we will walk you through how to setup the API key (required when using the SDK to interact with hub entities) and then how to create and manage projects, agents, and knowledge bases using the SDK.

  • Projects: Projects are the top-level organizational units in Giskard Hub. They provide a workspace for your team to collaborate on LLM agent testing and evaluation.

  • Agents: The AI systems, LLMs or agents you want to test and evaluate

  • Knowledge bases: Domain-specific information sources we can use to test your agents

Configure API keys and find entity IDs

Set up API keys and retrieve entity IDs programmatically

Find API keys and resource IDs
Setup projects

Setup and organize projects

Setup projects
Setup agents

Setup and organize your deployed agents

Setup agents
Setup knowledge bases

Setup and organize knowledge bases we can use to test your agents

Setup knowledge bases

High-level workflow

        graph LR
    A([<a href="projects.html" target="_self">Create Project</a>]) --> B([<a href="agents.html" target="_self">Create Agent</a>])
    A --> C([<a href="knowledge_bases.html" target="_self">Create Knowledge Base</a>])
    C --> E[Upload Documents]
    B --> F[<a href="../scan/index.html" target="_self">Ready for Testing</a>]
    E --> F