alexturkey / crisperwhisper-turkce-kelime-zamani

Verbatim speech-to-text with word timestamps on a 4 GB GPU: CrisperWhisper 2.0 Turbo (CT2 int8) + wav2vec2 CTC alignment. Turkish-first, Linux/WSL2.

xlite-dev / Awesome-LLM-Inference

📚A curated list of Awesome LLM/VLM Inference Papers with Codes: Flash-Attention, Paged-Attention, WINT8/4, Parallelism, etc.🎉

Saganaki22 / ComfyUI-Breeze-TTS-2

Breeze TTS 2 nodes for ComfyUI: voice clone, voice design, and voice direction with bilingual (EN/ZH) speech, inline vocal events, INT8 ConvRot quantized builds, and full ComfyUI / AIMDO dynamic-VRAM integration.

drJhonatan00 / Game_Translation_Pipeline

A high-performance, offline game translation framework built in Python. Powered by CTranslate2 (INT8 quantization) and Helsinki-NLP neural models, this tool automates multi-language translation for game scripts while strictly protecting low-level syntax, variables, and memory pointers.

DocPang / qwen38-k100ai-int8-optimization

Qwen3.8-27B INT8/W8A8 optimization for Hygon K100AI: SGLang, TP1/TP4, DFlash2 and long-context Agent workloads

PINTO0309 / PINTO_model_zoo

A repository for storing models that have been inter-converted between various frameworks. Supported frameworks are TensorFlow, PyTorch, ONNX, OpenVINO, TFJS, TFTRT, TensorFlowLite (Float32/16/INT8), EdgeTPU, CoreML.

sindresorhus / file-type

Detect the file type of a file, stream, or data

intel / neural-compressor

SOTA low-bit LLM quantization (INT8/FP8/MXFP8/INT4/MXFP4/NVFP4) & sparsity; leading model compression techniques on PyTorch, TensorFlow, and ONNX Runtime

Saganaki22 / ComfyUI-Viggle-Animate-H3

ComfyUI nodes for Viggle-Animate minimax H3 finetune

sepiablue-ai / ComfyUI-MiniMax-H3-TaoMate-C3

TaoMate-H3 3-step acceleration package for ComfyUI on an RTX 4070 12GB: 4-bit (W4A4) FFN weights, 10% sparse attention and extra INT8 weight caching, with Windows setup and sample workflows.

sepiablue-ai / ComfyUI-H3-X2-Stream

ComfyUI nodes for MiniMax H3: INT8 X2 VAE and asynchronous NVENC saving. 5-second 1088x1920 video with audio in about 60 s on an RTX 4070 12GB, about 30% faster than the FP16 X2 VAE.

yzfly / edgejev

离线可用的本地类型化决策：4 核 CPU 单题 15.6ms。Local & offline Jev / System One inference on CPU — ONNX + INT8, no torch at runtime. 支持 laya / kev / PlayJev

alesha-pro / atlas

Interactive canvas for taking an LLM apart tensor by tensor: measured INT8/INT4/FP8 error, distributions, spectra and outlier channels for every weight tensor

AydinAdnan / PulseVAD

Ultra-tiny 2.1k streaming voice activity detector (2.1 KB INT8). 200 ms window for microcontrollers, edge devices, and DSPs. ships with ONNX, TorchScript, and standalone C header.

drowzeys / keys-SM121-Optimized-MiniMax-H3-Nvidia-Sol-Engine-Kijai-SolAttn_Triton-Single-DGX-Spark

MiniMax-H3 33B audio+video DiT accelerated 1.54x on a single NVIDIA DGX Spark (GB10, sm_121): NVIDIA Sol-Engine FirstBlockCache + batched VAE decode ported to single-GPU ComfyUI, Sol-Attn patched for compute 12.1, kijai Triton INT8/TMA kernels. Benchmarks, charts, one-shot installer, agent recipe.

matsuo-koya / minimax-h3-notes

Measured speed-ups for MiniMax H3 on one RTX 5090 (ComfyUI): INT8 attention, FastH3 LoRA conversion, distributed segments, and what didn't work

moznoazachem / giga-pisar-cli

Распознавание русской речи в командной строке: GigaAM v3, ONNX int8, на процессоре, без интернета

drowzeys / keys-Mac-TensorFold-MiniMax-H3-MLX

MiniMax H3 (video + audio) on TensorFold 0.6.5 with an H3 family, Mac Studio M5 Ultra: 5 s 864x480 clip in ~50 s, 40 s at 768x448 — the fastest H3 we have measured on Apple Silicon; int8 tensor-unit kernels + Turbo adapter; one-shot + GHCR carrier

kdrkdrkdr / faster-enhancer.c

Pure C implementation of FastEnhancer. 3.3x faster than the ONNX Runtime graph, same quality.

a2307588073-arch / zynq-yolov3-tiny-accelerator

INT8 single-class YOLOv3-Tiny accelerator and OV5640-to-HDMI bare-metal demo for Xilinx Zynq-7000 XC7Z100, with PyTorch training and parameter-export tools. Topics yolov3-tiny, fpga, zynq-7000, xc7z100, verilog, vivado, vitis, pytorch, int8-quantization, object-detection, axi4-stream, ov5640, hdmi, embedded-systems, computer-vision

StartLuxLabs / StartLux-Prism

Fast, exact inference for StartLux-Decision models on NVIDIA GPUs: the released GGUF files on int8 and 4-bit tensor cores, behind the /v1/systemone API, with up to 5.3× lower latency than vLLM in FP8 and bit-identical answers.