vllm-project / vllm
A high-throughput LLM inference and serving engine featuring PagedAttention, continuous batching, and an OpenAI-compatible API server.
vllm-project / vllm
Anil-matcha / Open-Generative-AI
Open-source web studio for generating AI images and videos through 600+ hosted models from one interface.