Use all your network adapters at once on Windows/Linux/Mac: per-connection load balancing over Wi-Fi, Ethernet and phone/USB tethers (TUN + Wintun)
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
Open-source, high-performance AI gateway that works as your LLM gateway, MCP gateway and agent gateway. One OpenAI-compatible API for 10,000+ models, with failover, load balancing, semantic caching, virtual keys, budgets and MCP Code Mode. Works with any SDK or agent and adds under 200µs of overhead at 5k RPS.
Official implementation of "Omni-Woodpecker: Hallucination Correction via Evidence-Prior Rebalancing for Omni LLMs"
A self-hosted AI gateway for enterprises. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
Net Switch: per-app internet for Windows. Choose which connection each app uses, combine your lines, and fail over automatically.
eBPF-based Networking, Security, and Observability
⚡️ Open-source AI Gateway — Use any SDK to call 100+ LLMs. Built-in failover, load balancing, cost control & end-to-end tracing.
This project presents a comparative machine learning framework for heart attack risk prediction using Python. It includes data preprocessing, feature engineering, SMOTE for class balancing, cross validation, and performance evaluation of multiple ML models.
A proxy node pool management tool based on sing-box, supporting multiple protocols, automatic failover and load balancing. 基于 sing-box 的代理节点池管理工具,支持多协议、多节点自动故障转移和负载均衡。
The Cloud-Native API Gateway and AI Gateway
Repository for the next iteration of composite service (e.g. Ingress) and load balancing APIs.
The ultimate datacenter management solution for Proxmox VE and XCP-NG. Unified multi-cluster control, intelligent load balancing, and seamless cross-cluster VM migrations — all in one beautiful interface.
ProxCenter is an alternative to VMware vCenter for Proxmox environments. It provides a modern, intuitive web interface to manage multiple Proxmox VE clusters and Proxmox Backup Server instances from a single pane of glass.
OpenAI-compatible API bridge for NetEase Youdao LobsterAI (龙虾) — Go, zero external deps, multi-account pool with credit-based load balancing
This is a project that unifies the management of LLM APIs. It can call multiple backend services through a unified API interface, convert them to the OpenAI format uniformly, and support load balancing. Currently supported backend services include: OpenAI, Anthropic, DeepBricks, OpenRouter, Gemini, Vertex, etc.
Universal LLM Gateway: One API, every LLM. OpenAI/Anthropic-compatible endpoints with multi-provider translation and intelligent load-balancing.
Windows 網路流量轉發與代理工具:WinDivert 驅動層封包攔截、多進程攔截規則、多網卡路由與故障轉移、IPv6 雙棧、SOCKS5/HTTP 代理、PySide6 即時監控介面 (MIT)
Scalable PostgreSQL connection manager
APISIX Ingress Controller for Kubernetes
the docker for Apache APISIX
A simple and ultrafast http reverse proxy serving multiple domain names and terminating TLS for http/1.1, 2 and 3, written in Rust
Microservices library - scalecube-services is a high throughput, low latency reactive microservices library built to scale. It features: API-Gateways, service-discovery, service-load-balancing, the architecture supports plug-and-play service communication modules and features. built to provide performance and low-latency real-time stream-processing
LudicrousDB is an advanced database interface for WordPress that supports replication, failover, load balancing, & partitioning
Kafka storage rebalancing, automated replication throttle, cluster API and more
APINodeDiamond is a distributed, async data processing engine that leverages load-balancing and auto-scaling for high-performance Node applications.
Exact chemical equation balancing with rational linear algebra.
The lowest-overhead LLM router. Production-ready, highly available, one OpenAI-compatible endpoint in front of 80 providers and your own vLLM/SGLang — 0.76 µs per request, no I/O on the request path, cache-affinity routing, RBAC, budgets and a 13-screen UI in the binary.
⚡ High-performance Rust web server and reverse proxy built on Cloudflare Pingora. 🧾 Caddyfile-compatible config · 🔐 automatic HTTPS · 🚀 HTTP/1.1, HTTP/2, HTTP/3 · ⚖️ load balancing · 📁 static files.
Workload-aware persistent expert-tile scheduling for irregular MoE inference kernels on NVIDIA Blackwell GPUs
Consul Load-Balancing made simple
eBPF based cloud-native load-balancer for Kubernetes|Edge|Telco|IoT|XaaS.