Project management for MEV Research
Trainable fast and memory-efficient sparse attention
Up to 4× faster LLM decoding on Apple Silicon, lossless. Native MLX port of DeepSeek's DSpark & z-lab's DFlash speculative decoding — Gemma-4, Qwen3.8, Muse-Glimmer, Nemotron, LFM2.5, Ornith-1.0, ternary Bonsai-27B.
Fast and memory-efficient classical machine learning operators
All RTL9210(A/B) firmwares, tools, dump, infos ect...
From teacher to tiles — a from-scratch LLM distillation & serving engine: custom Triton/CUDA kernels, FSDP distillation, paged-KV continuous batching, speculative decoding, a Rust gateway, a JAX oracle, and interpretability tooling.
⚡ Ultra Flash: Scaling Real-Time Streaming Video Generation to High Resolutions
DeepSeek v4 Flash EXL3 on one DGX Spark
GLM-5.3-Flash EXL3 on one 24 GB RTX 3090 + DDR4: elastic GPU expert cache, zero-copy experts, AVX2 CPU tier, OpenAI API
A unified, torch-native training framework for MTP and block-parallel speculative decoding.
DeepSeek v4.1 Flash EXL3 2.9 bpw for 2x DGX Sparks
GLM-5.3-Flash (NVFP4) on 2x NVIDIA DGX Spark - vLLM TP2, 262K context, MTP. World-first deploy recipe: 7 day-0 bugs found and fixed, patched sm121 image, probes and full report.
Deployment kit: Qwen3.8-27B EXL3 3.5bpw target + DFlash2 EXL3 5.0bpw speculative draft — launcher, config, model cards
Performance-tuned llama.cpp for AMD Strix Halo (gfx1151): FA + MoE-prefill fixes with a bundled current Mesa driver. Vulkan and HIP; portable dir, Docker, and distrobox.
Pinned one-DGX-Spark Docker recipe for DeepSeek V4 Flash with EXL3, SparkInfer, and 262K NVFP4 MLA KV cache
—
Heterogeneous prefill/decode for DeepSeek-V4-Flash: CUDA prefill (DGX Spark, vLLM) -> Metal decode (Mac Studio, oMLX) over plain 10GbE
DeepSeek-V4-Flash-0731 284B inference in ~25 GB of RAM / Qwen3.8-Next-Flash inference in ~15 GB of RAM on any M-series MacBook
DeepSeek-V4.1-Flash EXL3 on one 24 GB RTX 3090 + DDR4 + NVMe: staged-DMA prefill, AVX2 CPU expert tier, elastic VRAM expert cache, Engram on disk, OpenAI API
[COLMW'26 Spotlight] AdaFlash: Adaptive Speculative Decoding via On-Policy Distilled Diffusion Drafters
DeepSeek-V4.1-Flash on a single DGX Spark (GB10): resident hot experts + NVMe streaming, DSpark, OpenAI API. Work in progress.
让普通电脑也能运行超大模型:64GB 内存可运行 DeepSeek V4 Flash,并可为角色扮演、代码等任务加载特调专家。
Qwen3.8-Flash-Next on 2× RTX 3090: with 128 GB RAM up to 4,191 tok/s prefill · 111.5 tok/s decode (131K prompt), full 256K window at 2,865 tok/s; with 64 GB RAM 3,410 tok/s prefill · 84 tok/s decode. New: opt-in uncensored mode (runtime abliteration, no new weights).
DeepSeek-V4-Flash-0731 on 4x CMP 170HX (sm_80): 98 tok/s decode, ~5300 tok/s prefill. DSpark speculative decoding under pipeline parallelism, which vLLM does not support upstream.
GLM-5.3-Flash (abliterated EXL3) on 2x NVIDIA DGX Spark with the TensorFold engine: 1.8x faster decode than vLLM, 4x256k concurrent threads, byte-exact speculative decoding. Work in progress.
闪电.skill:照 Anthropic 两周把 claude.ai 提速 3 倍的方法,给你的网站提速。先量、再证、后爬,用棘轮锁住只许变好。
A local app that rents a GPU in your own Colab account and serves Qwen3.8 on it: 27B on an A100-40G, or Flash-Next (125B-A6B MoE) on an A100-80G. The cost is shown before it starts; chat with images; Codex or any OpenAI client uses a fixed local /v1. Auto-stop, CU ledger, live prefill/decode. Windows, macOS, Linux.
FlashREINFORCE: Critic-Free, Single-Rollout, Asynchronous RL for Agentic Language Models
High-performance Lemonade alternative for AMD Strix Halo & Radeon — latest MoE models (Ling-3.0-Flash, Qwen 3.8 Flash Next, Ornith 1.5), bleeding-edge RDNA 3.5 Wave64/ROCmFP4 kernels, and silicon-tuned profiles.
FlashRec is a CUDA-graph engine for generative recommendation: wide beam search (3–5 SID steps, n=50–512+) over a trie-constrained catalog, in-process FP8 serving, and ranked beams on /v1/chat/completions.
Reproducible refusal-subspace editing and TP=2 deployment of DeepSeek V4 Flash 0731 on two DGX Sparks
Custom inference recipes for NVIDIA DGX Spark — Qwen 122B DFlash hybrid
GLM-5.3-Flash (NVFP4) at TP=4 across 4x ASUS GX10 / GB10 - vLLM + mentat instead of Ray, 524k context, DFlash2. Minimal working recipe.
Run original DeepSeek V4.1 Flash FP4/FP8 weights on a 16 GB M1 Mac mini with bounded SSD streaming in MLX. Recipe, benchmarks, and demo.
Flash an old-firmware Jetson Orin Nano to JetPack 7.2 on NVMe with only a Mac + one USB stick — no x86 host, no SD card. Firmware workarounds + local VLM/camera/PyTorch scripts + honest benchmarks.
GLM-5.3-Flash on 4× NVIDIA CMP 170HX with vLLM: up to 482.6 tok/s single-user, up to 943.7 tok/s at 8 users, 262K context, TP4 or PP4, one-command container install
DeepSeek V4.1 Flash on 4x RTX PRO 6000 Blackwell: native weights, DSpark, vision, NVMe or locked RAM Engram offload.
DeepSeek V4-Flash Vision RAG 让 AI 真正"看懂" 一份 PDF,然后你对它提问:它告诉你答案、答案在第几页, 并把那一页的原图展示出来给你核对。 基于 DeepSeek 视觉大模型 deepseek-v4-flash-vision-exp 的 PDF 深度问答与检索 (vision RAG)agent skill。支持文字版 PDF,也支持扫描版;能看懂 图表、表格、代码块、公式,而不只是认字。
🔥 Leonardo Web/API 任务网关:账号池调度、Cookie ZIP 导入、Token/JWT 协议续签、积分与并发管理;统一 JSON 任务接口覆盖 Hailuo H3、Seedance 2.0/2.5、Kling O3、Gemini Omni Flash、Veo 3.1、GPT Image 2、Nano Banana 2/Pro、Seed Audio 1.0。
极快的ComfyUI内FlashVSR视频超分放大节点.
Turn a ~$5 AliExpress clock into a physical AI usage dashboard (Claude, Codex, multi-account). No firmware flashing.
DeepSeek V4-Flash Vision Video RAG 让 AI 真正"看懂" 一段视频,然后你对它提问:它告诉你答案、答案发生在 第几分几秒,并切出那一段的可播放片段和关键帧给你核对。 基于 DeepSeek 视觉大模型 deepseek-v4-flash-vision-exp 的视频理解与问答 (video RAG)agent skill。先按时间轴抽帧阅读、建立索引(一次性),再对问题做 本地粗筛 → 视觉精排 → 深读回答;回答带 [MM:SS] 时间戳引用,自动生成 自包含 HTML 预览页(内嵌可播放片段 + 关键帧 + 答案),双击浏览器即看。
Nano Banana (official) API (`gemini-2.5-flash-image-preview-official`): model id, pricing, parameters and copy-paste examples for the OpenAI-compatible APIMart endpoint.
Fast, capable GLM-5.3-Flash FP4-Local on two DGX Sparks: opinionated Atlas serving and reproducible inference research.
逆向 Nano Banana 2 Lite Ext API: 1K $0.0125. model ID `gemini-3.1-flash-lite-image-ext`, OpenAI-compatible, async task + cost in every response, $1 minimum top-up. nano-banana-2-lite-ext-reverse-api-cn.
ingeniería inversa Nano Banana Ext API: 1K $0.0125. model ID `gemini-2.5-flash-image-preview`, OpenAI-compatible, async task + cost in every response, $1 minimum top-up. nano-banana-ext-reverse-api-es.
Resource-aware multi-agent orchestration for Codex and DeepSeek Harness (All in Flash DSH plugin)
GLM-5.3-Flash EXL3 (320B MoE) on 2x NVIDIA DGX Spark — production serving kit, 1M context, 97%+ multi-session prefix caching, DFlash2 spec decode
Serve Qwen3.8-Flash-Next (turboderp ExLlamaV3 pack) on one NVIDIA DGX Spark with exllamav3
rekayasa balik Nano Banana Ext API: 1K $0.0125. model ID `gemini-2.5-flash-image-preview`, OpenAI-compatible, async task + cost in every response, $1 minimum top-up. nano-banana-ext-reverse-api-id.
リバース Nano Banana Ext API: 1K $0.0125. model ID `gemini-2.5-flash-image-preview`, OpenAI-compatible, async task + cost in every response, $1 minimum top-up. nano-banana-ext-reverse-api-ja.
Nano Banana (official) API (`gemini-2.5-flash-image-preview-official`): model id, pricing, parameters and copy-paste examples for the OpenAI-compatible APIMart endpoint.
FlashDexRetarget: Accelerating Dexterous Manipulation Data Generation through Multi-Motion Retargeting
Verified Qwen3.8 Flash-Next GGUF recipe for one NVIDIA DGX Spark or ASUS Ascent GX10
Validated GLM-5.3 Flash recipe for 2x NVIDIA RTX PRO 6000 Blackwell 96GB: 262K context, EXL3/TR3, adaptive MTP, tools, and vision.
Nano Banana 2 (official) API (`gemini-3.1-flash-image-preview-official`): model id, pricing, parameters and copy-paste examples for the OpenAI-compatible APIMart endpoint.
Reverse-Engineering Nano Banana 2 Lite Ext API: 1K $0.0125. model ID `gemini-3.1-flash-lite-image-ext`, OpenAI-compatible, async task + cost in every response, $1 minimum top-up. nano-banana-2-lite-ext-reverse-api-de.
Reverse-Engineering Nano Banana Ext API: 1K $0.0125. model ID `gemini-2.5-flash-image-preview`, OpenAI-compatible, async task + cost in every response, $1 minimum top-up. nano-banana-ext-reverse-api-de.
реверс-инжиниринг Nano Banana 2 Ext API: 1K $0.015; 2K $0.02; 4K $0.025. model ID `gemini-3.1-flash-image-preview`, OpenAI-compatible, async task + cost in every response, $1 minimum top-up. nano-banana-2-ext-reverse-api-ru.
Nano Banana (official) API (`gemini-2.5-flash-image-preview-official`): model id, pricing, parameters and copy-paste examples for the OpenAI-compatible APIMart endpoint.