justxor / deepseek-local-guide-ru

🐋 Полный гайд на русском: как установить и запустить DeepSeek локально (V4, R1) на ПК, Mac и сервере — Ollama, llama.cpp, LM Studio, vLLM, Open WebUI, API, RAG, агенты, fine-tuning, лучшие фишки

peonist-ai / halogen-flash-server

The fastest way to run Qwen3.8-Flash-Next on Strix Halo (gfx1151)

inference-sh / skills

inference.sh Agent skills for using our API to give your agents access to hundreds of apps and other agents

raullenchai / twinspark

Production-grade recipe for DeepSeek-V4-Flash-0731 (284B MoE) on 2x NVIDIA DGX Spark: self-healing 2-node vLLM cluster, reboot-verified, tuned DSpark speculative decoding (~75 tok/s), full benchmarks, OpenAI Codex CLI integration

modelsphere / modelsphere

ModelSphere is an open-source LLM inference infrastructure designed to make production-grade model serving simple, efficient, and continuously optimized.

Datura-ai / lium-localmaxxing

Reproduce Lium's LocalMaxxing leaderboard runs (7 boards, 20 Verified) on a rented Lium GPU in one script — vLLM/llama.cpp recipes, measured cost per million tokens

azampatti / GB10-3.8-Flash-Next

A script to launch Qwen3.8-Flash-Next in a single DGX-Spark (or its variants) at 40+ tok/s inference speed.

satellitedown / fast-long-context-cinference

One-menu RTX 5090 setup for non-Swift Huihui Qwen3.8-27B NVFP4 with Cinference, MTP-10 and K8V4.

Layr-Labs / mlxfast-bonsai2-27b-engine

Ternary Bonsai 2 27B MLX inference speedup benchmark engine

satellitedown / fafstmobel-cinference

One-menu RTX 5090 installer for fafstmobel with Cinference, DFlash2, K8V4, and vision.