📈 GH Trending Explorer 🎲 Surprise me

Search: flash · Language: C++ · clear

Niko1221 / Strata

Qwen3.8-Flash-Next on any consumer hardware: one-click install for Windows / Linux. Strata inference engine, OpenAI/Anthropic API on localhost, optional image input.

▲ ~3.8k/7d ★ 31k C++ 2d ago
mw00 / project-maya

Project Maya - run GLM-5.3-Flash (321B MoE) and DeepSeek-V4.1-Flash-1017 (748B MoE) privately on your own GPU(s), from one card to 16, NVIDIA or AMD, Linux or Windows. Engine, server, dashboard, OpenAI- and Anthropic-compatible API, quant tools.

▲ ~677/7d ★ 1.5k C++ 1d ago
VecSzn / PolyStrata

Run large AI models on your own PC: Qwen3.8-Flash-Next on Strata's engine, and GLM 5.3 Flash, DeepSeek V4 Flash, LFM2.5, Qwen3.6, Ornith 1.5, Gemma 4, Tiel Coder and MiniCPM-V on a second engine written for PolyStrata. One-click install for Windows and Linux, OpenAI/Anthropic API on localhost.

▲ ~203/7d ★ 396 C++ today
Indras-Mirror / Xolotl

Xolotl (formerly Strata-DSV4.1): DeepSeek-V4.1-Flash, all 552B, on one gaming PC (RTX 4090 + 90 GB RAM) at ~27 tok/s, plus GLM-5.3-Flash, Qwen3.8-Flash-Next and Qwen3.8-27B. A heavily extended fork of Strata: MoE experts tiered across VRAM, pinned RAM and NVMe; OpenAI + Anthropic API.

▲ ~154/7d ★ 296 C++ today
M-Abozaid / esp32-c3-adblock

Pi-hole-class DNS ad-blocker on a $2 ESP32-C3 (no PSRAM): 537k domains as 40-bit FNV-1a hashes in flash, binary-searched. UDP DNS sinkhole + web dashboard. https://youtube.com/shorts/RaxszOUMi8E?feature=share

▲ ~128/7d ★ 3.3k C++ 17d ago
gufo-org / gufo

The Open Source Strix Halo AI engine. Qwen 3.8 Flash Next Q4_K_XL: 1,801.01 pp, 73.17 tg single user, 194.37 tok/s 8 users; Qwen 3.8 27B Q4_K_XL: 656.33pp, 70.56tg tok/s single user with DFlash2

▲ ~114/7d ★ 885 C++ 1d ago
IPADS-SAI / Mobiinfer-Android

MobiInfer runs 35B-A3B-class MoE models fully on-device on the Qualcomm Hexagon NPU, streaming experts from flash with lookahead scheduling (LES) and DSpark speculation.

▲ ~98/7d ★ 89 C++ 1d ago
flashrt-project / FlashRT

FlashRT is a high-performance realtime inference engine for small-batch, latency-sensitive AI workloads. The flagship integration is production VLA control for Pi0, Pi0.5, GROOT N1.6, and Pi0-FAST. Also support llm e.g, qwen3.6-27B

▲ ~86/7d ★ 752 C++ 1d ago
flameshot-org / flameshot

Powerful yet simple to use screenshot software :desktop_computer: :camera_flash:

▲ ~65/7d ★ 31k C++ 1d ago
jesdga95 / basalt

Local inference engine for Qwen3.8-Flash-Next on NVIDIA Blackwell

▲ ~49/7d ★ 126 C++ 1d ago
Luce-Org / lucebox

LLM speculative inference server for heterogeneous hardware & consumer GPUs

▲ ~21/7d ★ 2.9k C++ 1d ago
IIIIIllllIIIIIlllll / Qwenox

An inference framework customized for AI MAX 395, compatible with both Linux and Windows, and supports deploying only qwen3.8-flash-next. This project is for reference and learning purposes only. 为AI MAX 395定制的推理框架,Linux和Windows通用,只能部署qwen3.8-flash-next。本项目仅供参考学习使用。

▲ ~19/7d ★ 109 C++ today
shawnshekari / strixite

LLM inference engine written from scratch in HIP for AMD Strix Halo (gfx1151) and Qwen3.8-Flash-Next - ~50 tokens/s out to 492k context

▲ ~16/7d ★ 75 C++ 1d ago
Wallawalla47 / Infernix

C++/CUDA single-GPU inference engine for Qwen3.8 (incl. Qwen3.8-Flash-Next with offloaded experts) on the RTX 5090; grew from NInfer

▲ ~12/7d ★ 134 C++ 1d ago
sergqwer / strata-nvfp4

Strata fork: Qwen3.8-Flash-Next 125B MoE in NVFP4 on one RTX 20-50 card (12 GB+) and 64 GB of RAM or more. Setup installs our GPTQ quants (huihui abliterated, OrcaRouter) from Hugging Face. CPU experts on AVX-512 or AVX2 (+AVX-VNNI), all experts in RAM from 92 GB, a low-RAM mode below, vision, W4A8 prompts. Windows / CUDA 13.

▲ ~9/7d ★ 185 C++ 4d ago
iamankushpandit / Gume

Open-source ESP32 educational game console firmware — 40 games, two-player play over BLE, CYD touchscreen, browser flasher, no telemetry https://hackaday.io/project/206948-braino-a-40-game-learning-console-on-a-cyd

▲ ~9/7d ★ 88 C++ 1d ago
Apolog1ze-Dev / QwFNfer

A custom inference engine tuned for Qwen4 architecture. Currently runs Qwen3.8-Flash-Next at 15+ tok/s on 16GB of VRAM and 30 GB of RAM

▲ ~5/7d ★ 55 C++ 20d ago
1115714829 / llama.cpp-v100

llama.cpp optimized for NVIDIA Tesla V100 (SM70): large MoE Qwen3.8-Flash-Next with MTP (prefill 3464 tok/s at 200K context, 6x V100-16GB) and Qwen3.8-27B with DFlash2 (decode up to 225 tok/s); 2-6 GPUs, 262K-512K context, multimodal, concurrent serving.

▲ ~5/7d ★ 47 C++ 6d ago
headpiece747 / ninfer-5090-windows

Native Windows port of NInfer engine for RTX 5090. Features Qwen3.8-27B with QUASAR and NInfer models, MTP/DFlash2 with vision and 262,144 context

▲ ~2/7d ★ 73 C++ 2d ago
whylurking / IsaacRecomp

Native C++ recompilation of The Binding of Isaac (Flash) — 60 fps, 1080p, Windows/Linux/Switch. Requires the original game from Steam

▲ ~2/7d ★ 52 C++ 3d ago
DeepSeekV4Flash0731 / DeepSeek-V4-Flash-0731

DeepSeek V4 Flash 0731 - free deepseek v4 flash download, gguf, ollama, deepseek v4 pro 0813. deepseek v4 flash vs pro, benchmark, MoE, 1M context, compressed sparse attention, coding. CUDA/CPU, no API key, Windows local AI. Download:🡇

▲ ~2/7d ★ 28 C++ 1mo ago
esprfid / esp-rfid

ESP8266 RFID (RC522, PN532, Wiegand, RDM6300) Access Control system featuring WebSocket, JSON, NTP Client, Javascript, SPIFFS

▲ ~0/7d ★ 1.5k C++ 22d ago
pingcap / tiflash

The analytical engine for TiDB and TiDB Cloud. Try free: https://tidbcloud.com/free-trial

▲ ~0/7d ★ 1.0k C++ today
bigbigmdm / IMSProg

IMSProg - software for CH341A-based programmers to work with I2C, SPI and MicroWire EEPROM/Flash chips

▲ ~0/7d ★ 708 C++ 2d ago
Geramy / LSE

HRX, LOOM, Mac, and AMD running top speed kernels with a self optimizing engine.

▲ ~0/7d ★ 33 C++ 11d ago
isichan-ai / Strata-GLM

Strata fork that runs GLM-5.3-Flash (320B-A18B, 157 GB) on one PC: RTX 5090 + 128 GB RAM + NVMe, ~30 tok/s chat. Fork of Niko1221/Strata (MIT).

▲ ~0/7d ★ 33 C++ 10d ago
qhfan / FlashPrefillv2

FlashPrefill V2: Block-Sparse Prefill Attention for Long-Context LLM Serving

▲ ~0/7d ★ 31 C++ 1mo ago
otheru-ai / ember

DeepSeek-V4-Flash inference for AMD Strix Halo