Skip to main content
Source Code: examples/hardware_advisor_agent.py
The Hardware Advisor agent helps you figure out what size LLM your system can run by detecting your actual hardware capabilities.
Privacy-First: All hardware detection runs locally on your machine. No data leaves your system.

​
Quick Start

This starts an interactive session where you can ask about your hardware and get language model recommendations.

​
Example Interactions

Check your hardware:
Get recommendations:
Check specific models:

​
How It Works

The agent uses three tools: The 70% Rule: Models should use less than 70% of available RAM to leave 30% overhead for inference operations (KV cache, context window, etc.).

​
Requirements

  • Lemonade Server must be running for hardware detection
  • GAIA installed: uv pip install amd-gaia
GAIA auto-starts Lemonade Server on first use if it’s not already running.

​
Troubleshooting

Error: Failed to get hardware information from Lemonade ServerSolution: Start Lemonade Server:
Possible causes:
  • Windows: PowerShell may be restricted. Run as administrator.
  • Linux: lspci not installed. Install with: sudo apt install pciutils
Note: The agent continues with CPU-only recommendations if GPU detection fails.
Requirements for NPU:
  • Ryzen AI processor (8000/9000 series)
  • NPU drivers installed
  • Lemonade Server configured for NPU
The agent works without NPU - it just won’t recommend NPU-accelerated models.

​
Learn More

Build Your Own

Want to understand how this agent works or build something similar? Follow the step-by-step Hardware Advisor Playbook.