pgdogdev / pgdog

PostgreSQL connection pooler, load balancer and database sharder.

ghuntley / underclass

underclass: an OpenAI-compatible pooling proxy that pins sessions to one account (prompt cache stays warm), cools quota-exhausted subscriptions until their window resets, and fails fast with the earliest Retry-After when the whole pool is dry.

intentee / paddler

Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale 🏓🦙 Alternative to projects like llm-d, Docker Model Runner, etc but with less moving parts and simple deployments built around ggml ecosystem. Runs on CPU and GPU.

sadoyan / aralez

Aralez (Արալեզ), Reverse proxy built on top of Cloudflare's Pingora

dorianverlaine / pingclair

⚡ High-performance Rust web server and reverse proxy built on Cloudflare Pingora. 🧾 Caddyfile-compatible config · 🔐 automatic HTTPS · 🚀 HTTP/1.1, HTTP/2, HTTP/3 · ⚖️ load balancing · 📁 static files.