📈 GH Trending Explorer 🎲 Surprise me

← all repos

tashfeenahmed / freellmapi

git clone https://github.com/tashfeenahmed/freellmapi.git v0.16.6 · today 🔥 on GitHub Trending today

7.4 billion tokens per month. 34 free LLM providers. 635 free model endpoints. All behind one /v1 endpoint, plus any custom OpenAI-compatible endpoint. Smart routing, automatic failover, encrypted keys. Personal experimentation only.

—
stars, 24h
+3.8k
stars, 7 days · #24
+10k
stars, 30 days · #32
38k
★ total · +11% this week
5.2k
forks · 49 open issues

Star history starts 2026-10-20; the chart appears after the second daily snapshot.

LanguageTypeScript
LicenseMIT
Created2026-04-21 (6mo ago)
Last pushtoday
Watchers207
OwnerUser

Seen on GitHub Trending

  • 2026-10-20 — #4 monthly in typescript · +10,330 ★
  • 2026-10-20 — #12 monthly · +10,330 ★
  • 2026-10-20 — #9 weekly in typescript · +3,789 ★

Links

README excerpt
# FreeLLMAPI
**7.4 billion tokens per month. 34 free LLM providers. 635 free model endpoints. One OpenAI-compatible endpoint.**
Aggregate free tiers from dozens of providers, plus custom OpenAI-compatible chat, embedding, image, and audio endpoints, behind a single `/v1` API. Keys are stored encrypted. A router picks the best available model for each request, falls over to the next provider when one is rate-limited, and tracks per-key usage so you stay under every free-tier cap.
**freellmapi.co** · browse the full catalog: 474 model families, 635 free endpoints
**English** · 简体中文 · Русский
Your router updates its own model catalog from a signed feed: new free models, quota changes, and compatibility fixes land without a `git pull`. Free installs get the monthly snapshot, so a model reaches them 30 days after it joins the live feed; premium routers get it the same day.
**Go live at freellmapi.co** ($19/yr, cancel anytime).
---
## Contents
- Why this exists
- Supported providers
- Compatible CLIs & coding agents
- How it compares
- Features
- Quick start
- Desktop app
- Works with OpenAI-compatible clients
- Languages
- Premium (live catalog)
- Using the API
- Screenshots
- How it works
- FAQ
- Limitations
- Contributing
- Disclaimer
**Guides:** Install & deploy · API reference · Clients & coding agents · Prompt compression · Architecture & internals · Documentation index · Contributor guide
## Why this exists
Every serious AI lab now offers a free tier, a few million tokens a month, a few thousand requests a day. On its own each tier is a toy. Stacked together, they add up to roughly **7.4 billion tokens per month** of working inference capacity, across **474 model families / 635 provider endpoints** from small-and-fast to reasonably capable.
The problem is that stacking them by hand is painful: thirty-four different SDKs, thirty-four different rate limits, thirty-four places a request can fail. FreeLLMAPI collapses that into one OpenAI-compatible endpoint. Point any OpenAI client library at your local server, and it routes transparently across whichever providers you've added keys for.
And the free-tier landscape shifts weekly: providers launch models, retire them, and change quotas without notice. FreeLLMAPI tracks all of that for you. The router pulls a signed model catalog from freellmapi.co on its own, so your install keeps up without a `git pull`. See Premium (live catalog) for how fast it keeps up.
## Supported providers
 Google 
 Groq 
 Cerebras 
 OpenCode Zen 
 Mistral 
 OpenRouter 
 Cloudflare 
 Cohere 
 Z.ai (Zhipu) 
 NVIDIA 
 HuggingFace 
 ModelScope Qwen3 · DeepSeek V4 · GLM-5 (needs Aliyun cn binding) 
 … and 22 more free providers 
Plus a **custom** provider — point chat, embedding, image, or audio models at any OpenAI-compatible endpoint (llama.cpp, LM Studio, vLLM, a local Ollama, or a remote gateway) from the Keys page.
The full, always-current list lives at **freellmapi.co/models** with per-model rate limits, context windows, an