xlite-dev / Awesome-LLM-Inference
📚A curated list of Awesome LLM/VLM Inference Papers with Codes: Flash-Attention, Paged-Attention, WINT8/4, Parallelism, etc.🎉
xlite-dev / Awesome-LLM-Inference
PINTO0309 / PINTO_model_zoo
A repository for storing models that have been inter-converted between various frameworks. Supported frameworks are TensorFlow, PyTorch, ONNX, OpenVINO, TFJS, TFTRT, TensorFlowLite (Float32/16/INT8), EdgeTPU, CoreML.
sindresorhus / file-type
Detect the file type of a file, stream, or data
intel / neural-compressor
SOTA low-bit LLM quantization (INT8/FP8/MXFP8/INT4/MXFP4/NVFP4) & sparsity; leading model compression techniques on PyTorch, TensorFlow, and ONNX Runtime
Saganaki22 / ComfyUI-Viggle-Animate-H3
ComfyUI nodes for Viggle-Animate minimax H3 finetune
Saganaki22 / ComfyUI-Breeze-TTS-2
Breeze TTS 2 nodes for ComfyUI: voice clone, voice design, and voice direction with bilingual (EN/ZH) speech, inline vocal events, INT8 ConvRot quantized builds, and full ComfyUI / AIMDO dynamic-VRAM integration.
a2307588073-arch / zynq-yolov3-tiny-accelerator
INT8 single-class YOLOv3-Tiny accelerator and OV5640-to-HDMI bare-metal demo for Xilinx Zynq-7000 XC7Z100, with PyTorch training and parameter-export tools. Topics yolov3-tiny, fpga, zynq-7000, xc7z100, verilog, vivado, vitis, pytorch, int8-quantization, object-detection, axi4-stream, ov5640, hdmi, embedded-systems, computer-vision
alesha-pro / atlas
Interactive canvas for taking an LLM apart tensor by tensor: measured INT8/INT4/FP8 error, distributions, spectra and outlier channels for every weight tensor
AydinAdnan / PulseVAD
Ultra-tiny 2.1k streaming voice activity detector (2.1 KB INT8). 200 ms window for microcontrollers, edge devices, and DSPs. ships with ONNX, TorchScript, and standalone C header.
drJhonatan00 / Game_Translation_Pipeline
A high-performance, offline game translation framework built in Python. Powered by CTranslate2 (INT8 quantization) and Helsinki-NLP neural models, this tool automates multi-language translation for game scripts while strictly protecting low-level syntax, variables, and memory pointers.
sepiablue-ai / ComfyUI-MiniMax-H3-TaoMate-C3
TaoMate-H3 3-step acceleration package for ComfyUI on an RTX 4070 12GB: 4-bit (W4A4) FFN weights, 10% sparse attention and extra INT8 weight caching, with Windows setup and sample workflows.
sepiablue-ai / ComfyUI-H3-X2-Stream
ComfyUI nodes for MiniMax H3: INT8 X2 VAE and asynchronous NVENC saving. 5-second 1088x1920 video with audio in about 60 s on an RTX 4070 12GB, about 30% faster than the FP16 X2 VAE.
drowzeys / keys-SM121-Optimized-MiniMax-H3-Nvidia-Sol-Engine-Kijai-SolAttn_Triton-Single-DGX-Spark
MiniMax-H3 33B audio+video DiT accelerated 1.54x on a single NVIDIA DGX Spark (GB10, sm_121): NVIDIA Sol-Engine FirstBlockCache + batched VAE decode ported to single-GPU ComfyUI, Sol-Attn patched for compute 12.1, kijai Triton INT8/TMA kernels. Benchmarks, charts, one-shot installer, agent recipe.
DocPang / qwen38-k100ai-int8-optimization
Qwen3.8-27B INT8/W8A8 optimization for Hygon K100AI: SGLang, TP1/TP4, DFlash2 and long-context Agent workloads
matsuo-koya / minimax-h3-notes
Measured speed-ups for MiniMax H3 on one RTX 5090 (ComfyUI): INT8 attention, FastH3 LoRA conversion, distributed segments, and what didn't work
yzfly / edgejev
离线可用的本地类型化决策：4 核 CPU 单题 15.6ms。Local & offline Jev / System One inference on CPU — ONNX + INT8, no torch at runtime. 支持 laya / kev / PlayJev
moznoazachem / giga-pisar-cli
Распознавание русской речи в командной строке: GigaAM v3, ONNX int8, на процессоре, без интернета
drowzeys / keys-Mac-TensorFold-MiniMax-H3-MLX
MiniMax H3 (video + audio) on TensorFold 0.6.5 with an H3 family, Mac Studio M5 Ultra: 5 s 864x480 clip in ~50 s, 40 s at 768x448 — the fastest H3 we have measured on Apple Silicon; int8 tensor-unit kernels + Turbo adapter; one-shot + GHCR carrier
kdrkdrkdr / faster-enhancer.c
Pure C implementation of FastEnhancer. 3.3x faster than the ONNX Runtime graph, same quality.