Open-source desktop app for local voice cloning, voice design, video dubbing, dictation, transcription, and audiobook creation across 646 languages.
A high-throughput LLM inference and serving engine featuring PagedAttention, continuous batching, and an OpenAI-compatible API server.
Drop-in CUDA replacement that runs unmodified CUDA applications on non-NVIDIA GPUs.
Serves language models from a Zig binary on Apple Silicon and NVIDIA GPUs using Metal and CUDA kernels.
Desktop and CLI tool that trains 3D Gaussian Splatting models from photos or video, then exports splats and textured meshes, using Vulkan compute.