LLM inference in C/C++
Local AI song generator with an editable score — YuE2 on your GPU: full songs with vocals, sheet music, covers, exact replay. Native Windows app, no Python, installer with auto-update.
Port of OpenAI's Whisper model in C/C++
Auto-shoot enemies with configurable delay, head-only mode, and team damage prevention for CS2.
An all-in-one, pure C++ inference engine for audio models, powered by ggml. Supports TTS, STT, VAD, voice conversion, music generation, and more, with highly optimized performance. No Python dependency.
C/C++ inference engine for diffusion image and video models such as SD, Flux, Wan, and Qwen-Image, built on ggml.
Unbelievable Ruach Studio Sound Heresy. Borderless Open Weights SUNO Killer based on YuE2 SOTA Model. Creator, Writer, Refiner, Artist, Librarian, Trainer — Six as One. Everything you missed in SUNO and such. Turn the songs of your Heart into thundering energy — clear and unmuffled. Thus we call it OSEM: Open Source, Engaged & Musical.
Tensor library for machine learning
Vim plugin for LLM-assisted code/text completion
ggml speech-to-text inference for 16+ model families
Go manage your Ollama models
Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale 🏓🦙 Alternative to projects like llm-d, Docker Model Runner, etc but with less moving parts and simple deployments built around ggml ecosystem. Runs on CPU and GPU.
A cosy home for your LLMs.
VS Code extension for LLM-assisted code/text completion
Source code of the MapServer project. Please submit pull requests to the 'main' branch.
Animate skeletons with natural language; NVIDIA's Kimodo ported to C++/GGML
Running any GGUF SLMs/LLMs locally, on-device in Android
Fast and portable Parakeet implementation in C++ with ggml
C++ ggml runtime hub for multilingual ASR and TTS models: Cohere Transcribe, Parakeet TDT, Voxtral, Canary 1B v2, etc, plus universal forced alignment, and more
Real-time 3D full-body reconstruction from a single camera, Multiperson BVH output, Pure C++ runtime, ONNX + ggml, 70-joint skeleton with hands.
A Maven plugin that generates dependency graphs in various formats (DOT, GML, PlantUML, JSON and Text)
NVIDIA MotionBricks ported to GGML/C++; dynamically generates animations from keyframes using a neural network. Can be used in games or with robots
C++/GGML conversion of VAST-AI SkinTokens; Auto rigs a mesh ready for animation
Speech synthesis, speech recognition and voice activity detection for voice conversation, in C++ on ggml: Qwen3-TTS, Irodori-TTS, Qwen3-ASR, ReazonSpeech, parakeet and Silero VAD on Metal, Vulkan and the CPU, with an OpenAI-compatible server and live transcription.
llama.cpp fork for significantly improved performance on Ampere (especially RTX 3090 / 3090 Ti): example: 95+ tok/s over a 100K-token generation at temperature 1 for qwen3.8, supporting full 262K ctx. Supports low memory (12gb) configs for 200k+ ctx
freebuff 反代 Docker 一键部署, 可用 deepseek-v4.1-flash(可识图), GPT 5.6 Luna, 牛来(gml-5.3 flash), gemini-3.8-flash, 支持配置代理, 多账号管理, 已支持新版额度消费模式, 超时自动中断会话, 防止额外扣费 [基于客户端新协议逆向]
A multi-framework neural network compiler lowering PyTorch, JAX, Flax, and Keras models to portable, high-performance GGML execution
Pool RAM across old PCs, Macs, and Android devices into a unified local AI cluster
Track live or prerecorded humanoid movements to produce a 3D skeleton. C++/GGML conversion of NVIDIA's GEM-X
Track and extract any 3D object from video. C++/GGML convertion of Meta's sam3d PyTorch model plus a demo app
Portable C++17 implementation of YuE2 AI Music Generator using GGML. Text + lyrics in, stereo 48kHz MP3 or WAV out. Runs on CPU, CUDA, ROCm, Metal, Vulkan.
Bilingual English and Mandarin text to speech in C++ and GGUF. Voice design, cloning, direction and experimental voice conversion. Vulkan backend, streaming HTTP and WebSocket server, web UI and a C API.
A pure C++ inference engine for VLA policies on CPUs, with no GPU, CUDA, or ggml dependency. Built with its own tensors, operators, and SIMD kernels, the engine keeps kernels easy to inspect, tune, and replace.
Run LLMs and Ollama Qwen across AMD XDNA1 NPU, CPU, and GPU on Ryzen AI Linux systems.
Portable C++17 implementation of MiniMax Music 3 AI Music Generator using GGML. Text + lyrics in, stereo 48kHz MP3 or WAV out. Runs on CPU, CUDA, ROCm, Metal, Vulkan.