vllm-project / vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

apache / kafka

Apache Kafka - A distributed event streaming platform