vllm-project / vllm

A high-throughput LLM inference and serving engine featuring PagedAttention, continuous batching, and an OpenAI-compatible API server.

TencentCloud / Octop

Self-hosted AI assistant with multi-user support, multi-agent teams, a web console, CLI, and IM chat integrations.