GAIA SDK Reference
What is GAIA?
GAIA is AMD’s open-source agent factory: skills, evals and an auto-fix loop for building agent harnesses that run locally on your computer. The GAIA agent is the harness we built to show what it can do. This SDK is the layer underneath, for building your own. A harness can:- Answer questions by searching through documents
- Process images and extract information
- Interact with databases
- Respond to voice commands
- Automate workflows
- And much more!
- Developers building agent harnesses (people who only want to use the GAIA agent should start at Install GAIA)
- Teams creating specialized AI workflows
- Researchers experimenting with AI applications
- Anyone wanting to run AI locally on AMD hardware
- 🏠 Privacy: Everything runs on your machine
- ⚡ Speed: AMD NPU/iGPU acceleration
- 🔧 Flexibility: Build exactly what you need
- 🧪 Evals: Measure a harness with
gaia eval agentand let--fixpatch failures
How This Documentation Works
This SDK reference is organized by component type. Each section includes:- 📖 What it does - High-level purpose
- 🎯 When to use it - Common use cases
- 💻 Code examples - Working, copy-paste ready code
- ⚠️ Important notes - Gotchas and best practices
- Quick Start - Build your first agent in 5 minutes
- Core Agent System - Understand the foundation
- Complete Examples - See real-world patterns
Quick Start
Understanding AI Agents
Before we dive in, let’s understand what an AI agent is: Traditional Program:- Users talk naturally: “Find customers in Texas and email them”
- LLM breaks it down: Use
search_customerstool, thensend_emailtool - Your code just provides the tools, LLM orchestrates them
- No complex if/else logic needed!
Installation
Using uv (recommended - 10-100x faster than pip):- Python 3.10 or higher
- Lemonade Server installed, for local LLM inference. Run
gaia initonce;gaia daemonstarts and supervises the server from then on.
- ⚡ 10-100x faster than pip
- 🔒 Better dependency resolution
- 📦 Recommended by GAIA team
Your First Agent (5 Minutes)
Let’s build a simple agent that can search and analyze data:- You defined tools (search_data, analyze_data)
- You described the agent’s personality (system prompt)
- The agent automatically figured out which tools to call and in what order
- The LLM orchestrated the workflow based on user’s natural language
What’s Next?
Explore the SDK documentation organized by topic:Core Concepts
- Agent System - Foundation of all GAIA agents
- Tools - Registering agent capabilities
- Console - Output handling and display
SDKs
- Agent SDK - Conversational AI with memory
- MCP Client - Connect to external tools via Model Context Protocol
- LLM Integration - Working with language models
- Vision Models - Image understanding
User Guides
- Document Q&A - RAG-powered document search and retrieval
- Voice Interaction - Speech-to-text and text-to-speech
- The Flagship GAIA Agent - Conversation, documents, data, web, memory, and skills
- API Server - OpenAI-compatible API
Advanced Topics
- Tool Mixins - Reusable tool collections
Guides & Resources
- Configuration - Environment and settings
- Testing - Testing your agents
- Security - Security best practices
- Best Practices - Code organization and patterns
- Complete Examples - Full working examples
- Advanced Patterns - Complex use cases
- Troubleshooting - Common issues and solutions
Get Help
- GitHub Issues - Bug reports and features
- Discord Community - Chat with developers
- Email: [email protected]