freellmapi
tashfeenahmed · tashfeenahmed/freellmapi
Aggregates free tiers from dozens of LLM providers into a single OpenAI-compatible /v1 API endpoint, with smart routing and failover.
7.4 billion tokens per month. 34 free LLM providers. 635 free model endpoints. All behind one /v1 endpoint, plus any custom OpenAI-compatible endpoint. Smart routing, automatic failover, encrypted keys. Personal experimentation only.
Preview
What you can do with it
- Use various free LLMs interchangeably in your AI agent development without changing code.
- Experiment with different LLMs for specific tasks to find the best free option.
- Build an AI application that automatically switches LLM providers to avoid rate limits on free tiers.
Try asking your agent
- “Generate a creative story plot using any available free LLM, ensuring diverse outputs.”
- “Translate this paragraph into French, then rephrase it in a formal tone using a different LLM.”
- “Test the sentiment analysis capabilities of 5 different free LLMs on this customer review.”
Safety check
Usable, but read the notes first.
- ●Installer downloads a remote script and pipes it to the shell.
README.md
Automated scan of the repo files. Always review code you run.
From the README
FreeLLMAPI
7.4 billion tokens per month. 34 free LLM providers. 635 free model endpoints. One OpenAI-compatible endpoint.
Aggregate free tiers from dozens of providers, plus custom OpenAI-compatible chat, embedding, image, and audio endpoints, behind a single /v1 API. Keys are stored encrypted. A router picks the best available model for each request, falls over to the next provider when one is rate-limited, and tracks per-key usage so you stay under every free-tier cap.
freellmapi.co · browse the full catalog: 474 model families, 635 free endpoints
English · 简体中文
Your router updates its own model catalog from a signed feed: new free models, quota changes, and compatibility fixes land without a git pull. Free installs get the monthly snapshot, so a model reaches them 30 days after it joins the live feed; premium routers get it the same day.
Go live at freellmapi.co ($19/yr, cancel anytime).
Contents
- Why this exists
- Supported providers
- Compatible CLIs & coding agents
- How it compares
- Features
- Quick start
- Desktop app
- Works with OpenAI-compatible clients
- Languages
- Premium (live catalog)
- Using the API
- Screenshots
- How it works
- FAQ
- Limitations
- Contributing
- Disclaimer
Guides: Install & deploy · API reference · Clients & coding agents · Prompt compression · Architecture & internals · Documentation index · Contributor guide
Why this exists
Every serious AI lab now offers a free tier, a few million tokens a month, a few thousand requests a day. On its own each tier is a toy. Stacked together, they add up to roughly 7.4 billion tokens per month of working inference capacity, across 474 model families / 635 provider endpoints from small-and-fast to reasonably capable.
The problem is that stacking them by hand is painful: thirty-four different SDKs, thirty-four different rate limits, thirty-four places a request can fail. FreeLLMAPI collapses that into one OpenAI-compatible endpoint. Point any OpenAI client library at your local server, and it routes transparently across whichever providers you've added keys for.
And the free-tier landscape shifts weekly: providers launch models, retire them, and change quotas without notice. FreeLLMAPI tracks all of that for you. The router pulls a signed model catalog from freellmapi.co on its own, so your install keeps up without a git pull. See Premium (live catalog) for how fast it keeps up.
Supported providers
Google Groq Cerebras OpenCode Zen
Mistral OpenRouter Cloudflare Cohere
Z.ai (Zhipu) NVIDIA HuggingFace
ModelScopeQwen3 · DeepSeek V4 · GLM-5 (needs Aliyun cn binding)
… and 22 more free providers
Plus a custom provider — point chat, embedding, image, or audio models at any OpenAI-compatible endpoint (llama.cpp, LM Studio, vLLM, a local Ollama, or a remote gateway) from the Keys page.
The full, always-current list lives at freellmapi.co/models with per-model rate limits, context windows, and free-token budgets.
Compatible CLIs & coding agents
Claude Code Codex CLI Gemini CLI Aider
Cline Roo Code Continue OpenCode
Goose Qwen Code Kilo Code Crush
Cursor Zed JetBrains AI DeepSeek Harness
AtomCode OpenClaw Hermes Agent Pi
… plus any OpenAI-compatible client, Anthropic SDK, Gemini SDK, or Ollama-capable app
Most of these configure themselves with one command — npx freellmapi setup-claude, setup-codex, setup-aider, setup-dsh (DeepSeek Harness), and eleven more generators that fetch your live catalog, back up existing config, and never clobber what's already there. Claude Code and Codex also get zero-persistence launchers (freellmapi launch, freellmapi launch-codex) that inject credentials into the child process only. Zed and JetBrains AI connect through the opt-in Ollama emulation; Gemini CLI speaks its native wire on /v1beta.
Per-tool recipes, the setup CLI reference, revocable URL tokens for headerless clients, and the MCP server all live in Clients & coding agents →
How it compares
Based on public documentation, July 2026 — corrections welcome.
Features
- Every OpenAI-style surface —
/v1/chat/completions,/v1/responses(what Codex CLI needs),/v1/completions(editor ghost-text autocomplete),/v1/images/generations,/v1/videos/generations,/v1/audio/speech,/v1/audio/transcriptions,/v1/embeddings, and/v1/models— streaming and non-streaming, from the official SDKs or any OpenAI-compatible client. API reference → - Anthropic Messages API —
/v1/messagesspeaks Anthropic's wire format over the same router, so Claude Code and the official Anthropic SDKs run against your free pool. [Details →](docs/en/api/01-rest-api.md#anthropic--