Streaming Persian (Farsi) speech recognition: fine-tuning NVIDIA Nemotron 3.5 ASR streaming. Data prep, training, evaluation, inference.
GLM-5.3-Flash EXL3 (320B MoE) on 2x NVIDIA DGX Spark — production serving kit, 1M context, 97%+ multi-session prefix caching, DFlash2 spec decode
Serve Qwen3.8-Flash-Next (turboderp ExLlamaV3 pack) on one NVIDIA DGX Spark with exllamav3
Measured SM121 compatibility recipe for MiniMax H3 FL2VA on one NVIDIA DGX Spark with vLLM-Omni and online FP8.
Verified Qwen3.8 Flash-Next GGUF recipe for one NVIDIA DGX Spark or ASUS Ascent GX10
Validated GLM-5.3 Flash recipe for 2x NVIDIA RTX PRO 6000 Blackwell 96GB: 262K context, EXL3/TR3, adaptive MTP, tools, and vision.
Qwen3.8-27B on SGLang for NVIDIA RTX PRO 6000 (96GB, SM120): DSpark speculative decoding, full 256K context, 8 concurrent requests
DLSS 5 Image & Video Converter - run NVIDIA's DLSS 5 neural renderer over your own photos and videos. Drag, drop, paste, convert.
Serving Qwen3.8-27B-FP8 on a single DGX Spark (GB10): 7.88 to 58.5 tok/s single-stream from decode strategy alone, weights untouched. Speculative decoding and prefix caching benchmarked, plus DFlash 2 — the only Qwen3.8-27B build that can serve it under vLLM.
NVIDIA RTX Video Super Resolution for ComfyUI, optimized for long videos with disk-backed processing and low RAM usage. Supports AI upscaling, denoising, deblurring, H.264/HEVC NVENC encoding, audio preservation, and an integrated video preview.
Serving 4-bit Qwen3.8-27B on a single DGX Spark (GB10): 75 tok/s single-stream, 246 tok/s aggregate at 8-way concurrency. NVFP4 vs MixedInt4-AutoRound vs the FP8 baseline, measured on one harness — including why the quantization advantage collapses to +0.2% by c16.
An open-source, hands-on mobile robotics course covering Jetson, ROS 2, AI perception, SLAM, autonomous navigation, semantic understanding, and robotic manipulation.
MiMo-V2.6-Flash-RL on 2x NVIDIA DGX Spark (GB10): vLLM TP2 + DFlash + vision/audio, fp8 KV 300K, four fixes for the stock image, measured baselines
SGLang for GLM-5.3-Flash on two or four RTX PRO 6000 Blackwell GPUs (SM120), with TP2 W4A16 and TP4 NVIDIA NVFP4 profiles.
Photographs to a textured mesh on one 8 GB NVIDIA card, offline. Built on TRELLIS.2, with a four view path, and the photographs' own pixels projected onto the texture so printed text stays readable.
Workflow-compatible NVIDIA RTX Video Super Resolution Pro node for ComfyUI with exact 16K hybrid output, RGB corruption protection, and mm + DPI print sizing.
Durable local inference for Oh My Pi: NInfer + Qwen3.8 27B on one RTX 3090/4090/5090, with restart-resumable OpenAI Responses state.
📖 GPU parallel programming from the ground up : CUDA C++ and Rust 🦀 kernels paired with clickable SVG 2D/3D architecture diagrams (warps, SMs, memory tiers). Includes reduction, scan, matmul, and a full image‑processing capstone
DeepSeek-V4.1-Flash on two NVIDIA DGX Sparks: EXL3 weights from the official checkpoint, upstream vLLM with our patches and decode kernels
Mixed-precision acceleration patch for MiniMax H3 inference on NVIDIA V100
Switchless RoCE collectives, NCCL profiles and fabric tooling for DGX Spark inference recipes
本项目是一套面向 AI Infra 初学者的 LLM 推理教程,目标是在一张 NVIDIA GeForce RTX 3080 Ti(12GB 显存)上,实现并讲清较为完整的单机 AI 推理基础设施。
Pinned, checksum-verified GLM-5.3-Flash EXL3 K2 recipe for one NVIDIA GB10.
GLM-5.3-Flash NVFP4 on 4x NVIDIA DGX Spark: vLLM TP4, DFlash2 adaptive draft, measured FP8 vs NVFP4 vs EXL3 vs SGLang
Open, calibrated System 1 decision models: typed choice / score / yes-no answers with a probability for every option. 400M to 80B; CPU, NVIDIA, Apple Silicon, LM Studio, Ollama and vLLM.
MiniMax-H3 33B audio+video DiT accelerated 1.54x on a single NVIDIA DGX Spark (GB10, sm_121): NVIDIA Sol-Engine FirstBlockCache + batched VAE decode ported to single-GPU ComfyUI, Sol-Attn patched for compute 12.1, kijai Triton INT8/TMA kernels. Benchmarks, charts, one-shot installer, agent recipe.
Unofficial Windows ComfyUI nodes for NVIDIA DLSS Super Resolution and experimental Neural Rendering, with still and video workflows.
RouteWeaver: experimental cache-safe speculative inference and CPU/GPU transfer optimization for Qwen 27B on low-VRAM NVIDIA GPUs.
Recover usable memory on DGX Spark with a 64 KiB kernel: an opt-in NVIDIA UVM page-table packing patch, build tools, and measured validation.
Distributed image and video generation in ComfyUI for two NVIDIA DGX Sparks.
High-throughput batched ASR for NVIDIA GPUs. Run Zipformer and NVIDIA NeMo Parakeet models through one Python API with TensorRT, custom CUDA plugins, GPU beam search, and word timestamps - up to 25,000 RTFx on B300.
An efficient WMP-based visual locomotion framework for Unitree Go1 with NVIDIA Warp depth rendering and Sim-to-Sim/Sim-to-Real deployment.
Userland fan control for NVIDIA DGX Spark, with additive RPM floors, a temperature-based curve, Secure Boot signing, and DKMS support.
YouTube 直播实时 AI 翻译字幕,支持本地 Ollama,英中双向。首次配置,日常双击启动。AI captions for YouTube livestreams with local Ollama. English ↔ Chinese. Windows/NVIDIA preview; setup once, double-click to start.
Local image generation and editing for NVIDIA DGX Spark, powered by Qwen-Image-2.1 and Gradio.
Motif-3 MoE training framework example (torchtitan-based, NVIDIA B200)
ComfyUI MiniMax H3 inference optimizations for NVIDIA Tesla V100 (SM70)
Reproducible Qwen3.8-27B NVFP4 + DFlash2 recipe and qualification evidence for one NVIDIA DGX Spark
GLM-5.3-Flash (FP8) + DFlash2 speculative decoding on 4x NVIDIA DGX Spark / ASUS GX10: vLLM TP4, 256K context, switchless ConnectX-7 ring with patched NCCL
Ornith-1.5-35B-A3B (NVFP4 + FP8 + MTP) on NVIDIA DGX Spark (GB10)
A tiered-memory system design for workloads that don't fit in RAM: measure the working set, pin the hot tier, stream the cold tier from flash. Ships the residency calculator, measurement harnesses, and the build recipes behind it. Predictions validated against public benchmarks.
双 SM80 / CMP 170HX 的 Qwen3.8-Flash-Next 社区 vLLM:NVIDIA NVFP4、GDS、TEP2、MTP6,支持 1~10 并发,词表与 PCIe 通信优化。中英文部署与可构建源码。
Qwen3.8-27B NVFP4 (W4A16 shipped recipe) + MTP on NVIDIA DGX Spark GB10/SM121 — vLLM v0.27.2rc0, FP8 KV, 262K context, full reproducibility pack
Windows GUI and CLI for upscaling video with NVIDIA RTX Video Super Resolution (no ComfyUI or PyTorch needed). Resumable segments for long films, batch queue, before/after preview, 720p–4K presets that keep aspect ratio, H.264/HEVC/ProRes/DNxHR output, never overwrites.
This patch removes restriction on maximum number of simultaneous NVENC video encoding sessions imposed by Nvidia to consumer-grade GPUs.
GPU-optimized version of the MuJoCo physics simulator, designed for NVIDIA hardware.
BioNeMo Recipes: For building and adapting AI models in drug discovery at scale
The open .char format for consistent characters. Face, body, wardrobe & voice in one file, consistent across every model.
ROS 2 and NVIDIA Isaac Sim based air-ground cooperative delivery system with robotic grasping and UAV visual alignment.
AlpaSim is an open-source autonomous vehicle simulation platform designed for development and testing of end-to-end AV policies