A high-throughput LLM inference and serving engine featuring PagedAttention, continuous batching, and an OpenAI-compatible API server.
Gradio web app for speech recognition, translation, voice cloning, TTS, and dubbing, including YouTube audio extraction and vocal isolation.