DeepSeek-V4.1-Flash-1017 EXL3 2.9bpw on 2x NVIDIA DGX Spark (GB10) with TensorFold: 2.1-2.3x the vLLM kit's decode speed.
Need for Speed: Most Wanted (PS2) port to PS Vita
Official Inference Code of EAGLE-4
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
LMCache: Supercharge Your LLM with the Fastest KV Cache Layer
🚀 A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (including fp8), and easy-to-configure FSDP and DeepSpeed support
LMDeploy is a toolkit for compressing, deploying, and serving LLMs.
Automatic CPU speed & power optimizer for Linux
An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries
Example models using DeepSpeed
A unified library of SOTA model optimization techniques like quantization, distillation, pruning, neural architecture search, speculative decoding, etc. It compresses deep learning models for downstream deployment frameworks like TensorRT-LLM, TensorRT, vLLM, etc. to optimize inference speed.
Jobs scraper library for LinkedIn, Indeed, Glassdoor, ZipRecruiter, Bayt, Naukri, BDJobs & HelloWork
LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.
Collect Lots of Shadowsocks, ShadowsocksR, Trojan, Vmess from Public Sources & Filter Best Nodes By Speed
GDM Science Skills to speed up agentic scientific workflows with better grounding and higher token efficiency. Integrate insights from AlphaGenome, AFDB, UniProt and 30+ other databases and tools.
Automatically mock your HTTP interactions to simplify and speed up testing
A super light-weight embedded code search engine CLI (AST based) that just works - improves speed and efficiency for coding agent 🌟 Star if you like it!
TokenSpeed is a speed-of-light LLM inference engine.
High-speed downloader for multiple platforms
Smassh your Keyboard, TUI Edition
Local Laya typed decisions on Apple Core ML and Neural Engine. Validated ports, ~5 ms short decisions on M3 Max, reproducible speed and energy benchmarks.
CF优选IP工具。动态获取Cloudflare优选IP,CloudflareSpeedTest测速。
Markdown parser, done right. 100% CommonMark support, extensions, syntax plugins & high speed. Now in Python!
Extension for Scikit-learn is a seamless way to speed up your Scikit-learn application
[NeurIPS'24 Spotlight, ICLR'25, ICML'25] To speed up Long-context LLMs' inference, approximate and dynamic sparse calculate the attention, which reduces inference latency by up to 10x for pre-filling on an A100 while maintaining accuracy.
ComfyUI nodes to crop before sampling and stitch back after sampling that speed up inpainting
BlackJAX is a Bayesian Inference library designed for ease of use, speed and modularity.
A Unix, Windows, Raspberry Pi Object Speed Camera using python3, opencv, video streaming, motion tracking. Includes a Standalone Web Server , Image Search using opencv template match and a whiptail Admin Menu Interface Includes picam and webcam Plugins for motion track security camera configuration including rclone sync scripts.
Airspeed Velocity: A simple Python benchmarking tool with web-based reporting
A lightweight, open-source network monitor for Windows that displays live upload/download speeds directly on the Taskbar with a native look and feel.
Oxyde ORM is a type-safe, Pydantic-centric asynchronous ORM with a high-performance Rust core designed for clarity, speed, and reliability.
A repo which compares the speed of different programming languages.
Speed up model training by fixing data loading.
Combine the power of nix-eval-jobs with nix-output-monitor to speed-up your evaluation and building process.
SEOMonster: a local, user-credential-driven MCP server for SEO workflows over Google Search Console, GA4, PageSpeed Insights, and Cloudflare. Read-first, open source.
One llama.cpp flag unlocks +33-39% decode speed for Qwen3.8-27B on consumer GPUs. The MTP head already ships inside your GGUF. Recipe, paired benchmarks, probe tool.
MiniMax-H3超级缓存加速插件
Run CUDA-targeted Windows applications on AMD GPUs with ZLUDA + ROCm/HIP.
Record breaking score (as of the first commit date)
Running ONNX/TRT version of the MiniMax-H3 VAE in ComfyUI, which increase speed by up to 1.7x
Speedrun for pretraining without backpropagation
GPU 性能与 AI Infra 学习项目:CUDA/Triton 算子、NCU/NSYS、vLLM/SGLang/TRT-LLM/ms-swift、PyTorch/DeepSpeed/ms-swift 训练、并行架构
Qwen3.8-Flash-Next (NVFP4) on DGX Spark in vLLM: one Spark 43.9 tok/s with our disk-backed n-gram table patch, staged gather and reduced-vocab MTP draft; TP2 SPEED 53.7; TP4 CONTEXT 9M KV pool. Launchers, patch, 40-prompt harness, KV ledger, credits. SGLang TP2 day-0 lane kept.
Unlocking Lossless Speedups in LLMs via Discrete Diffusion
Nearly SNFS-Speed Signature Forgery Sans Factoring N
首个MiniMaxH3 ComfyUI加速插件
极快的ComfyUI内VOSR2图片/视频超分放大节点.
极快的ComfyUI内QwenImage2.1加速节点.
—
MiniMax H3 300% speed本地部署指南(消费级 16GB 显存版):全栈加速链 cu130+SageAttention+TE-Speed 实测、模型组合、避坑清单
Find the most stable nearby Fastly CDN route and pin it in hosts to speed up GitHub downloads and X images. Windows & Linux, menu-driven, English/中文. 自動找出附近最順的 Fastly 路線並寫入 hosts,加速 GitHub 下載與 X 圖片。支援 Windows / Linux,中英文選單操作。
High-speed parallel stream engine & local web dashboard for streaming HTTP/HTTPS downloads directly to PlayStation 5 FTP storage. Pure Python standard library, zero pip packages, macOS & Windows.
极快的ComfyUI内FlashVSR视频超分放大节点.
Wave Forcing: Towards Speed-of-Light Streaming Video Generation
Self-hosted web dashboard and management suite for Amazon eero mesh networks with telemetry, AdGuard Home DNS sync, MQTT, Prometheus, and multi-arch Docker.
Benchmark your local LLMs: speed, memory, and quality, in one command. TUI leaderboard for Ollama, LM Studio, llama.cpp, and vLLM.
Ultimate assistant for WARDOGS (tactical FPS). Features: Unlimited Health, Unlimited Ammo, No Reload, Speed Hack, ESP, Wallhack, Radar, One-Hit Kills, Unlimited Resources, and more. 20+ functions.
A measurement-first lab for low-latency local camera inference with Glance.
Ultimate assistant for Fishing Planet. Features: Unlimited Money, Mega Experience, Infinite Gold, Easy Catching, Infinite Backpack Weight, No Repair Required, Fish ESP, Bite Alarm, Instant Catch, Fast Reeling, Game Speed Control, and more. 15+ functions.
MiniMax-H3 on single DGX Spark: keys Sol-Engine ports + Heretic TE + Spectrum/Sage speed + 0.5MP upscaler finish. Formal bench included.