Auto-shoot enemies with configurable delay, head-only mode, and team damage prevention for CS2.
LLM inference in C/C++
Port of OpenAI's Whisper model in C/C++
Tensor library for machine learning
Diffusion model(SD,Flux,Wan,Qwen Image,Z-Image,...) inference in pure C/C++
An all-in-one, pure C++ inference engine for audio models, powered by ggml. Supports TTS, STT, VAD, voice conversion, music generation, and more, with highly optimized performance. No Python dependency.
Vim plugin for LLM-assisted code/text completion
ggml speech-to-text inference for 16+ model families
Go manage your Ollama models
Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale ππ¦ Alternative to projects like llm-d, Docker Model Runner, etc but with less moving parts and simple deployments built around ggml ecosystem. Runs on CPU and GPU.
A cosy home for your LLMs.
VS Code extension for LLM-assisted code/text completion
Local AI song generator with an editable score β YuE2 on your GPU: full songs with vocals, sheet music, covers, exact replay. Native Windows app, no Python, installer with auto-update.
Animate skeletons with natural language; NVIDIA's Kimodo ported to C++/GGML
Running any GGUF SLMs/LLMs locally, on-device in Android
Fast and portable Parakeet implementation in C++ with ggml
C++ ggml runtime hub for multilingual ASR and TTS models: Cohere Transcribe, Parakeet TDT, Voxtral, Canary 1B v2, etc, plus universal forced alignment, and more
Real-time 3D full-body reconstruction from a single camera, Multiperson BVH output, Pure C++ runtime, ONNX + ggml, 70-joint skeleton with hands.
NVIDIA MotionBricks ported to GGML/C++; dynamically generates animations from keyframes using a neural network. Can be used in games or with robots
C++/GGML conversion of VAST-AI SkinTokens; Auto rigs a mesh ready for animation
Speech synthesis, speech recognition and voice activity detection for voice conversation, in C++ on ggml: Qwen3-TTS, Irodori-TTS, Qwen3-ASR, ReazonSpeech, parakeet and Silero VAD on Metal, Vulkan and the CPU, with an OpenAI-compatible server and live transcription.
llama.cpp fork for significantly improved performance on Ampere (especially RTX 3090 / 3090 Ti): example: 95+ tok/s over a 100K-token generation at temperature 1 for qwen3.8, supporting full 262K ctx. Supports low memory (12gb) configs for 200k+ ctx
A multi-framework neural network compiler lowering PyTorch, JAX, Flax, and Keras models to portable, high-performance GGML execution
Pool RAM across old PCs, Macs, and Android devices into a unified local AI cluster
Track live or prerecorded humanoid movements to produce a 3D skeleton. C++/GGML conversion of NVIDIA's GEM-X
Track and extract any 3D object from video. C++/GGML convertion of Meta's sam3d PyTorch model plus a demo app
Unbelievable Ruach Studio Sound Heresy. Borderless Open Weights SUNO Killer based on YuE2 SOTA Model. Creator, Writer, Refiner, Artist, Librarian, Trainer β Six as One. Everything you missed in SUNO and such. Turn the songs of your Heart into thundering energy β clear and unmuffled. Thus we call it OSEM: Open Source, Engaged & Musical.
Portable C++17 implementation of YuE2 AI Music Generator using GGML. Text + lyrics in, stereo 48kHz MP3 or WAV out. Runs on CPU, CUDA, ROCm, Metal, Vulkan.
Portable C++17 implementation of MiniMax Music 3 AI Music Generator using GGML. Text + lyrics in, stereo 48kHz MP3 or WAV out. Runs on CPU, CUDA, ROCm, Metal, Vulkan.
Bilingual English and Mandarin text to speech in C++ and GGUF. Voice design, cloning, direction and experimental voice conversion. Vulkan backend, streaming HTTP and WebSocket server, web UI and a C API.
A pure C++ inference engine for VLA policies on CPUs, with no GPU, CUDA, or ggml dependency. Built with its own tensors, operators, and SIMD kernels, the engine keeps kernels easy to inspect, tune, and replace.
Run LLMs and Ollama Qwen across AMD XDNA1 NPU, CPU, and GPU on Ryzen AI Linux systems.