Niko1221 / Strata
Qwen3.8-Flash-Next on any consumer hardware: one-click install for Windows / Linux. Strata inference engine, OpenAI/Anthropic API on localhost, optional image input.
Niko1221 / Strata
mw00 / project-maya
Project Maya - run GLM-5.3-Flash (321B MoE) and DeepSeek-V4.1-Flash-1017 (748B MoE) privately on your own GPU(s), from one card to 16, NVIDIA or AMD, Linux or Windows. Engine, server, dashboard, OpenAI- and Anthropic-compatible API, quant tools.
ggml-org / llama.cpp
LLM inference in C/C++
nace-ai / kapitsa
Blazing fast Apple Silicon optimized inference engine built for Qwen & Nemotron. OpenAI + Anthropic API compatible. Built by folks from nace.ai
Fincept-Corporation / FinceptTerminal
FinceptTerminal is a modern finance application offering advanced market analytics, investment research, and economic data tools, designed for interactive exploration and data-driven decision-making in a user-friendly environment.
LTSharpe / OblivionRemasteredPerformanceFix
Engine-level performance fix for Oblivion Remastered (UE5): higher fps in towns, far fewer travel hitches, same image. Source, benchmark and docs.
incoai / splash
A local inference engine for Apple silicon, built around the model.
duckdb / duckdb
DuckDB is a high-performance analytical database system
VecSzn / PolyStrata
Run large AI models on your own PC: Qwen3.8-Flash-Next on Strata's engine, and GLM 5.3 Flash, DeepSeek V4 Flash, LFM2.5, Qwen3.6, Ornith 1.5, Gemma 4, Tiel Coder and MiniCPM-V on a second engine written for PolyStrata. One-click install for Windows and Linux, OpenAI/Anthropic API on localhost.
LizardByte / Sunshine
Self-hosted game stream host for Moonlight.
ggml-org / whisper.cpp
Port of OpenAI's Whisper model in C/C++
Indras-Mirror / Xolotl
Xolotl (formerly Strata-DSV4.1): DeepSeek-V4.1-Flash, all 552B, on one gaming PC (RTX 4090 + 90 GB RAM) at ~27 tok/s, plus GLM-5.3-Flash, Qwen3.8-Flash-Next and Qwen3.8-27B. A heavily extended fork of Strata: MoE experts tiered across VRAM, pinned RAM and NVMe; OpenAI + Anthropic API.
dyang886 / Game-Cheats-Manager
Easily download and manage single-player game cheats for your convenience
PrismLauncher / PrismLauncher
A custom launcher for Minecraft that allows you to easily manage multiple installations of Minecraft at once (Fork of MultiMC)
Liset999 / ZenDesktop
A ultra-lightweight, high-performance Windows desktop and taskbar enhancement utility with a native C++ Windhawk mod and a standalone tray daemon.
k2-fsa / sherpa-onnx
Speech-to-text, text-to-speech, speaker diarization, speech enhancement, source separation, and VAD using next-gen Kaldi with onnxruntime without Internet connection. Support embedded systems, Android, iOS, HarmonyOS, Raspberry Pi, RISC-V, RK NPU, Axera NPU, Ascend NPU, x86_64 servers, websocket server/client, support 12 programming languages
0xShug0 / audio.cpp
An all-in-one, pure C++ inference engine for audio models, powered by ggml. Supports TTS, STT, VAD, voice conversion, music generation, and more, with highly optimized performance. No Python dependency.
Merserk / dlss5-visual-enhancer
DLSS 5 Neural Rendering for Images & Video with Frame Generation, RTX Video Super Resolution, HDR, and Color Grading
M2Team / NanaZip
The 7-Zip derivative intended for the modern Windows experience
tek-95 / ViceBounce
Make classic GTA Vice City bounce to your own music.
jesdga95 / basalt
Local inference engine for Qwen3.8-Flash-Next on NVIDIA Blackwell
deepseek-ai / FlashMLA
FlashMLA: Efficient Multi-head Latent Attention Kernels
TokisanGames / Terrain3D
A high performance, editable terrain system for Godot 4.
Likely7 / Veyra-NRVideo
Bring PS5 GTA6 to 120FPS with DLSS 5. An advanced Windows video player and capture enhancement tool featuring real-time preview for videos, images, and capture card sources. Combine AI-powered Super Resolution, DLSS5 image enhancement, and Frame Generation to deliver a next-generation visual experience.
skizzophrenic / SquachWatch-CYD
SquachWatch is a firmware for the Cheap Yellow Display that gamifies detecting things like Flock Cameras, Trackers, Meta Glasses and so much more!
wazuh / wazuh
Wazuh - The Open Source Security Platform. Unified XDR and SIEM protection for endpoints and cloud workloads.
google-ai-edge / mediapipe
Cross-platform, customizable ML solutions for live and streaming media.
flashrt-project / FlashRT
FlashRT is a high-performance realtime inference engine for small-batch, latency-sensitive AI workloads. The flagship integration is production VLA control for Pi0, Pi0.5, GROOT N1.6, and Pi0-FAST. Also support llm e.g, qwen3.6-27B
Neroued / ninfer
High-performance single-GPU inference for selected model checkpoints and GPUs.
lemonade-sdk / lemonade
Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https://discord.gg/5xXzkMu8Zk
AlkaidLab / foundation-sunshine
Sunshine fork: an enhanced sunshine, a self-hosted game streaming host for Moonlight with HDR10/HDR Vivid, virtual displays, advanced audio, optimized encoders, and a modern control panel.
PX4 / PX4-Autopilot
PX4 Autopilot Software
kvmem / kvmem
KVMem virtualizes KV memory across inference backends to make ultra-long-context local AI accessible on limited hardware.
microsoft / onnxruntime
ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator
VinceIP / fci-recomp
—
mozilla-ai / llamafile
Distribute and run LLMs with a single file.
TigerVNC / tigervnc
High performance, multi-platform VNC client and server
google-ai-edge / LiteRT-LM
LiteRT-LM is Google's production-ready, high-performance, open-source inference framework for deploying Large Language Models on edge devices.
heterodoxin / AbliteratedOutTheBox
llama.cpp fork that abliterates at inference
kvcache-ai / Mooncake
Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.
limbonaut / limboai
LimboAI - Behavior Trees and State Machines for Godot 4
leejet / stable-diffusion.cpp
Diffusion model(SD,Flux,Wan,Qwen Image,Z-Image,...) inference in pure C/C++
hluk / CopyQ
Clipboard manager with advanced features
deepseek-ai / 3FS
A high-performance distributed file system designed to address the challenges of AI training and inference workloads.
FreelancerDecomp / Freelancer-Decomp
Source code of Freelancer (2003) restored from original binaries
3145544645 / gouji
构屎 GOUJI — 纯 C++/CUDA 的三值 mini LLM。2 bit/权重，零 Python；联想记忆工具路由，零训练参数；143 个缺陷与 29 个变异测试记录在案。
openvinotoolkit / openvino
OpenVINO™ is an open source toolkit for optimizing and deploying AI inference
typesense / typesense
Open Source alternative to Algolia + Pinecone and an Easier-to-Use alternative to ElasticSearch ⚡ 🔍 ✨ Fast, typo tolerant, in-memory fuzzy Search Engine for building delightful search experiences
alibaba / MNN
MNN: A blazing-fast, lightweight inference engine battle-tested by Alibaba, powering high-performance on-device LLMs and Edge AI.
carla-simulator / carla
Open-source simulator for autonomous driving research.
wolfpld / tracy
Frame profiler
droogie / bbhost
Definitive Bloodborne PC Experience
microsoft / BitNet
Official inference framework for 1-bit LLMs
envoyproxy / envoy
Cloud-native high-performance edge/middle/service proxy
ceph / ceph
Ceph is a distributed object, block, and file storage platform
NVIDIA / cutlass
CUDA Templates and Python DSLs for High-Performance Linear Algebra
libjxl / libjxl
JPEG XL image format reference implementation
Stellarium / stellarium
Stellarium is a free GPL software which renders realistic skies in real time with OpenGL. It is available for Linux/Unix, Windows, macOS and Haiku. With Stellarium, you really see what you can see with your eyes, binoculars or a small telescope.
cactus-compute / cactus
Quantization, kernels, runtime and inference engine for mobiles, wearables, smart home and robots.
google-ai-edge / LiteRT
LiteRT, successor to TensorFlow Lite. is Google's On-device framework for high-performance ML & GenAI deployment on edge platforms, via efficient conversion, runtime, and optimization