vllm-project / vllm
A high-throughput LLM inference and serving engine featuring PagedAttention, continuous batching, and an OpenAI-compatible API server.
vllm-project / vllm
apache / kafka
Distributed event streaming platform for building high-throughput data pipelines and streaming applications.