Skip to main content

Flint AI on GitHub

Source code, example agents, and issue tracking

​
Two ways to prove agent quality

Run them separately or together for full coverage.
  • LLM-driven analysis. Understand context, not just patterns. Identify real problems, not just false alarms.
  • Behavioral testing. LLM-as-judge scores agent reliability.
  • 100% free. First results in minutes.

​
Try it now

Install Flint AI CLI and configure your LLM provider:
Requirements:
  • Python 3.11 or later
  • OpenGrep (required for flintai scan)
  • A running agent accessible over HTTP (required for flintai eval)
Supported frameworks: Google ADK, Google GenAI, Anthropic, OpenAI, OpenAI Agents SDK, LangGraph, CrewAI, AutoGen, HuggingFace Transformers, HuggingFace smolagents
1

Install

Using a virtual environment is recommended to avoid dependency conflicts:
Install Flint AI CLI:
The standard install is deliberately lean: it skips the machine-learning backends, which keeps the download roughly 2 GB smaller and avoids pulling CUDA on Linux.The built-in OWASP LLM evaluations, the PII and secret detectors, and flintai scan all run on the standard install. So does listing evaluations.Add the full extra when you want the Garak evaluations, the toxicity detector, or models pulled from HuggingFace and run locally:
Quote it. In zsh, the default shell on macOS, an unquoted [full] is a glob pattern and the command fails with no matches found.If you run something that needs the extra without it, the CLI stops with an error naming the extra rather than failing further in.
2

Configure your LLM provider

flintai-cli uses AI to analyze agent code and score reliability. Run the interactive setup:
You’ll be prompted to select a provider (Gemini, OpenAI, Anthropic, or LiteLLM), select a model, and enter your API key.flintai init runs automatically the first time you use Flint AI CLI in a non-CI environment. You can re-run it any time to reconfigure.
Run into issues? See install troubleshooting →
What’s next? Choose your path:

Scan in less than 5 minutes

Find agent code issues before deployment

Eval agent behavior at runtime

Get a 0.0-1.0 reliability score

​
Why Flint AI CLI?

Context, not patterns. Follows data flows. Flags real issues, not every match. Ship with confidence. Validate behavior, catch risks, prove readiness. Fast results. Install, scan, and ship in minutes.
Built for AI developers. Ask questions, get grounded answers. No context switching. Connect via MCP →

​
Start here

Install

Get started in minutes

Learn

Explore tutorials

Explore

Browse built-in tests