📈 GH Trending Explorer 🎲 Surprise me

Search: vllm · Language: Shell · clear

justxor / deepseek-local-guide-ru

🐋 Полный гайд на русском: как установить и запустить DeepSeek локально (V4, R1) на ПК, Mac и сервере — Ollama, llama.cpp, LM Studio, vLLM, Open WebUI, API, RAG, агенты, fine-tuning, лучшие фишки

▲ 125/7d ★ 133 Shell 4d ago
raullenchai / twinspark

Production-grade recipe for DeepSeek-V4-Flash-0731 (284B MoE) on 2x NVIDIA DGX Spark: self-healing 2-node vLLM cluster, reboot-verified, tuned DSpark speculative decoding (~75 tok/s), full benchmarks, OpenAI Codex CLI integration

▲ ~0/7d ★ 176 Shell 2mo ago
modelsphere / modelsphere

ModelSphere is an open-source LLM inference infrastructure designed to make production-grade model serving simple, efficient, and continuously optimized.

▲ ~0/7d ★ 81 Shell 2d ago
Datura-ai / lium-localmaxxing

Reproduce Lium's LocalMaxxing leaderboard runs (7 boards, 20 Verified) on a rented Lium GPU in one script — vLLM/llama.cpp recipes, measured cost per million tokens