freellmapi
tashfeenahmed · tashfeenahmed/freellmapi
Tổng hợp các gói miễn phí từ hàng chục nhà cung cấp LLM thành một endpoint API /v1 tương thích OpenAI duy nhất, với định tuyến thông minh và chuyển đổi dự phòng.
7.4 billion tokens per month. 34 free LLM providers. 635 free model endpoints. All behind one /v1 endpoint, plus any custom OpenAI-compatible endpoint. Smart routing, automatic failover, encrypted keys. Personal experimentation only.
Xem trước
Bạn có thể làm gì với nó
- Sử dụng nhiều LLM miễn phí thay thế cho nhau trong quá trình phát triển AI agent mà không cần thay đổi code.
- Thử nghiệm với các LLM khác nhau cho các tác vụ cụ thể để tìm ra lựa chọn miễn phí tốt nhất.
- Xây dựng một ứng dụng AI tự động chuyển đổi nhà cung cấp LLM để tránh giới hạn tốc độ trên các gói miễn phí.
Thử hỏi agent của bạn
- “Tạo một cốt truyện sáng tạo bằng cách sử dụng bất kỳ LLM miễn phí nào có sẵn, đảm bảo đầu ra đa dạng.”
- “Dịch đoạn văn này sang tiếng Pháp, sau đó diễn đạt lại theo giọng văn trang trọng bằng một LLM khác.”
- “Kiểm tra khả năng phân tích cảm xúc của 5 LLM miễn phí khác nhau trên đánh giá khách hàng này.”
Kiểm tra an toàn
Dùng được, nhưng nên đọc ghi chú trước.
- ●Trình cài đặt tải script từ xa và chạy thẳng bằng shell.
README.md
Quét tự động các file trong repo. Luôn xem lại code trước khi chạy.
Trích từ README
FreeLLMAPI
7.4 billion tokens per month. 34 free LLM providers. 635 free model endpoints. One OpenAI-compatible endpoint.
Aggregate free tiers from dozens of providers, plus custom OpenAI-compatible chat, embedding, image, and audio endpoints, behind a single /v1 API. Keys are stored encrypted. A router picks the best available model for each request, falls over to the next provider when one is rate-limited, and tracks per-key usage so you stay under every free-tier cap.
freellmapi.co · browse the full catalog: 474 model families, 635 free endpoints
English · 简体中文
Your router updates its own model catalog from a signed feed: new free models, quota changes, and compatibility fixes land without a git pull. Free installs get the monthly snapshot, so a model reaches them 30 days after it joins the live feed; premium routers get it the same day.
Go live at freellmapi.co ($19/yr, cancel anytime).
Contents
- Why this exists
- Supported providers
- Compatible CLIs & coding agents
- How it compares
- Features
- Quick start
- Desktop app
- Works with OpenAI-compatible clients
- Languages
- Premium (live catalog)
- Using the API
- Screenshots
- How it works
- FAQ
- Limitations
- Contributing
- Disclaimer
Guides: Install & deploy · API reference · Clients & coding agents · Prompt compression · Architecture & internals · Documentation index · Contributor guide
Why this exists
Every serious AI lab now offers a free tier, a few million tokens a month, a few thousand requests a day. On its own each tier is a toy. Stacked together, they add up to roughly 7.4 billion tokens per month of working inference capacity, across 474 model families / 635 provider endpoints from small-and-fast to reasonably capable.
The problem is that stacking them by hand is painful: thirty-four different SDKs, thirty-four different rate limits, thirty-four places a request can fail. FreeLLMAPI collapses that into one OpenAI-compatible endpoint. Point any OpenAI client library at your local server, and it routes transparently across whichever providers you've added keys for.
And the free-tier landscape shifts weekly: providers launch models, retire them, and change quotas without notice. FreeLLMAPI tracks all of that for you. The router pulls a signed model catalog from freellmapi.co on its own, so your install keeps up without a git pull. See Premium (live catalog) for how fast it keeps up.
Supported providers
Google Groq Cerebras OpenCode Zen
Mistral OpenRouter Cloudflare Cohere
Z.ai (Zhipu) NVIDIA HuggingFace
ModelScopeQwen3 · DeepSeek V4 · GLM-5 (needs Aliyun cn binding)
… and 22 more free providers
Plus a custom provider — point chat, embedding, image, or audio models at any OpenAI-compatible endpoint (llama.cpp, LM Studio, vLLM, a local Ollama, or a remote gateway) from the Keys page.
The full, always-current list lives at freellmapi.co/models with per-model rate limits, context windows, and free-token budgets.
Compatible CLIs & coding agents
Claude Code Codex CLI Gemini CLI Aider
Cline Roo Code Continue OpenCode
Goose Qwen Code Kilo Code Crush
Cursor Zed JetBrains AI DeepSeek Harness
AtomCode OpenClaw Hermes Agent Pi
… plus any OpenAI-compatible client, Anthropic SDK, Gemini SDK, or Ollama-capable app
Most of these configure themselves with one command — npx freellmapi setup-claude, setup-codex, setup-aider, setup-dsh (DeepSeek Harness), and eleven more generators that fetch your live catalog, back up existing config, and never clobber what's already there. Claude Code and Codex also get zero-persistence launchers (freellmapi launch, freellmapi launch-codex) that inject credentials into the child process only. Zed and JetBrains AI connect through the opt-in Ollama emulation; Gemini CLI speaks its native wire on /v1beta.
Per-tool recipes, the setup CLI reference, revocable URL tokens for headerless clients, and the MCP server all live in Clients & coding agents →
How it compares
Based on public documentation, July 2026 — corrections welcome.
Features
- Every OpenAI-style surface —
/v1/chat/completions,/v1/responses(what Codex CLI needs),/v1/completions(editor ghost-text autocomplete),/v1/images/generations,/v1/videos/generations,/v1/audio/speech,/v1/audio/transcriptions,/v1/embeddings, and/v1/models— streaming and non-streaming, from the official SDKs or any OpenAI-compatible client. API reference → - Anthropic Messages API —
/v1/messagesspeaks Anthropic's wire format over the same router, so Claude Code and the official Anthropic SDKs run against your free pool. [Details →](docs/en/api/01-rest-api.md#anthropic--