tardellirs / gemma3moe-builder
Sparse-upcycle a dense Gemma-3-270m into a Mixture-of-Experts (gemma3moe) and serve it on llama.cpp (CPU). Upcycle, train, inspect routing, GGUF.
tardellirs / gemma3moe-builder
seanyourhighness / vllm-sm12x-nvfp4-dflash2
All-NVFP4 vLLM + DFlash2 K7 for Blackwell (SM120/SM121): NVFP4 target/draft/KV, 262K context, optional CPU vision sidecar.
jceronch1 / open_suno
Programa para crear canciones tanto con GPU como CPU
CPUtester5465 / countbean-plugin
Countbean plugin for Claude Code β hosted plain-text (Beancount) accounting. Published from the countbean monorepo; do not edit here.
wieslawsoltes / Performance-Skill
Cross-platform .NET performance engineering skill for coding agents, covering CPU, memory, GC, benchmarking, concurrency, startup, native profiling, GPU rendering, and production diagnostics on macOS, Windows, and Linux.
manjunathshiva / opendecider
Open, calibrated System 1 decision models: typed choice / score / yes-no answers with a probability for every option. 400M to 80B; CPU, NVIDIA, Apple Silicon, LM Studio, Ollama and vLLM.
QLNI / SHADOW-50M-Instruct
SHADOW 50M Instruct: a proof of concept. 44M ternary parameters, exact circuits inside the model, memory on disk, 19.8 MB, offline on a CPU.
hawaiicoco / slotvox
End-to-end spoken language understanding toolkit: a small trainable neural audio codec with RVQ, joint intent-and-slot models over speech features, streaming partial intents, a speech-LLM instruction data pipeline, and turn-level evaluation with reproducible reports. NumPy core with a CPU-only torch extra; synthetic data only, fully offline.
lucaperl / paperless-local-ai
Local OCR, metadata automation and RAG document chat for Paperless-ngx using PaddleOCR and Ollama, designed for CPU-only self-hosted servers
kadenball / qwen38-27b-rtx3060-dcfr
RouteWeaver: experimental cache-safe speculative inference and CPU/GPU transfer optimization for Qwen 27B on low-VRAM NVIDIA GPUs.
StarWorkshop / wavrail
Streaming speech recognition toolkit: log-mel features, CTC greedy and prefix-beam decoding, transducer-style frame-synchronous emission, forced alignment, Chinese/English CER-WER metrics, and a chunked streaming pipeline with latency accounting. NumPy core with a CPU-only torch extra; trainable demos on synthetic audio, fully offline.
deepanshu406 / python-ebpf-profiling
eBPF-powered Python profiling toolkit CPU profiling, GC pauses, GIL contention, off-CPU analysis, network health
yzfly / edgejev
离线ε―η¨ηζ¬ε°η±»εεε³ηοΌ4 ζ Έ CPU ει’ 15.6msγLocal & offline Jev / System One inference on CPU β ONNX + INT8, no torch at runtime. ζ―ζ laya / kev / PlayJev
silentprior / paperless-paddle-ocr
CPU-friendly sidecar that OCRs paperless-ngx documents with PaddleOCR PP-OCRv6 and writes text back via the API.
c8dhjp4tyv-bit / hawkpoint-npu-llm
Run LLMs and Ollama Qwen across AMD XDNA1 NPU, CPU, and GPU on Ryzen AI Linux systems.
ZipengWu365 / TOMC
TOMC Memory: CPU context compression and task memory for Codex, Claude Code, Cursor, TRAE, WorkBuddy and other MCP clients.
onurtirpan / agentic-llm-token-and-performance-tests
The same HTTP API in 10 languages at 3 sizes, 30 implementations. Token cost for LLM agents, plus cold start, latency, throughput, CPU and memory. All measured, all verified over live HTTP.
intel / skills
Skills for running, porting, profiling, and tuning code on Intel CPUs, GPUs, and the libraries and runtimes behind them.