tashfeenahmed / freellmapi
git clone https://github.com/tashfeenahmed/freellmapi.git
v0.16.6 · today
🔥 on GitHub Trending today
7.4 billion tokens per month. 34 free LLM providers. 635 free model endpoints. All behind one /v1 endpoint, plus any custom OpenAI-compatible endpoint. Smart routing, automatic failover, encrypted keys. Personal experimentation only.
—
stars, 24h
+3.8k
stars, 7 days · #24
+10k
stars, 30 days · #32
38k
★ total · +11% this week
5.2k
forks · 49 open issues
Star history starts 2026-10-20; the chart appears after the second daily snapshot.
LanguageTypeScript
LicenseMIT
Created2026-04-21 (6mo ago)
Last pushtoday
Watchers207
OwnerUser
Seen on GitHub Trending
- 2026-10-20 — #4 monthly in typescript · +10,330 ★
- 2026-10-20 — #12 monthly · +10,330 ★
- 2026-10-20 — #9 weekly in typescript · +3,789 ★
Links
- GitHub: github.com/tashfeenahmed/freellmapi
- Homepage: https://freellmapi.co
- Releases · Issues · Hacker News mentions
README excerpt
# FreeLLMAPI **7.4 billion tokens per month. 34 free LLM providers. 635 free model endpoints. One OpenAI-compatible endpoint.** Aggregate free tiers from dozens of providers, plus custom OpenAI-compatible chat, embedding, image, and audio endpoints, behind a single `/v1` API. Keys are stored encrypted. A router picks the best available model for each request, falls over to the next provider when one is rate-limited, and tracks per-key usage so you stay under every free-tier cap. **freellmapi.co** · browse the full catalog: 474 model families, 635 free endpoints **English** · 简体中文 · Русский Your router updates its own model catalog from a signed feed: new free models, quota changes, and compatibility fixes land without a `git pull`. Free installs get the monthly snapshot, so a model reaches them 30 days after it joins the live feed; premium routers get it the same day. **Go live at freellmapi.co** ($19/yr, cancel anytime). --- ## Contents - Why this exists - Supported providers - Compatible CLIs & coding agents - How it compares - Features - Quick start - Desktop app - Works with OpenAI-compatible clients - Languages - Premium (live catalog) - Using the API - Screenshots - How it works - FAQ - Limitations - Contributing - Disclaimer **Guides:** Install & deploy · API reference · Clients & coding agents · Prompt compression · Architecture & internals · Documentation index · Contributor guide ## Why this exists Every serious AI lab now offers a free tier, a few million tokens a month, a few thousand requests a day. On its own each tier is a toy. Stacked together, they add up to roughly **7.4 billion tokens per month** of working inference capacity, across **474 model families / 635 provider endpoints** from small-and-fast to reasonably capable. The problem is that stacking them by hand is painful: thirty-four different SDKs, thirty-four different rate limits, thirty-four places a request can fail. FreeLLMAPI collapses that into one OpenAI-compatible endpoint. Point any OpenAI client library at your local server, and it routes transparently across whichever providers you've added keys for. And the free-tier landscape shifts weekly: providers launch models, retire them, and change quotas without notice. FreeLLMAPI tracks all of that for you. The router pulls a signed model catalog from freellmapi.co on its own, so your install keeps up without a `git pull`. See Premium (live catalog) for how fast it keeps up. ## Supported providers Google Groq Cerebras OpenCode Zen Mistral OpenRouter Cloudflare Cohere Z.ai (Zhipu) NVIDIA HuggingFace ModelScope Qwen3 · DeepSeek V4 · GLM-5 (needs Aliyun cn binding) … and 22 more free providers Plus a **custom** provider — point chat, embedding, image, or audio models at any OpenAI-compatible endpoint (llama.cpp, LM Studio, vLLM, a local Ollama, or a remote gateway) from the Keys page. The full, always-current list lives at **freellmapi.co/models** with per-model rate limits, context windows, an