algorithmicsuperintelligence / optillm
git clone https://github.com/algorithmicsuperintelligence/optillm.git
Optimizing inference proxy for LLMs
—
stars, 24h
—
stars, 7 days
—
stars, 30 days
4.3k
★ total
404
forks · 22 open issues
Star history starts 2026-10-20; the chart appears after the second daily snapshot.
LanguagePython
LicenseApache-2.0
Created2024-08-22 (2y ago)
Last push9d ago
OwnerOrganization
GitHub topics
agentagentic-aiagentic-frameworkagentic-workflowagentsapi-gatewaychain-of-thoughtgenailarge-language-modelsllmllm-inferencellmapimixture-of-expertsmoamonte-carlo-tree-searchopenaiopenai-apioptimizationprompt-engineeringproxy-server