All repos — GH Trending Explorer

We propose Prism, a dynamic sparse attention framework for natively training joint video-audio generation models at 2K.

DeepSelect: TopK kernels for DeepSeek Sparse Attention (DSA) and Samplers

CasADi is a symbolic framework for numeric optimization implementing automatic differentiation in forward and reverse modes on sparse matrix-valued computational graphs. It supports self-contained C-code generation and interfaces state-of-the-art codes such as SUNDIALS, IPOPT etc. It can be used from C++, Python, Matlab/Octave, Julia or Javascript

zechengtang / Spark-H3

Adaptive Block Sparse Attention for MiniMax-H3

paradedb / paradedb

One Postgres for your application data, full-text search, vector retrieval, and aggregations. Home of the pg_search extension.

borglab / gtsam

GTSAM is a library of C++ classes that implement smoothing and mapping (SAM) in robotics and vision, using factor graphs and Bayes networks as the underlying computing paradigm rather than sparse matrices.

AcademySoftwareFoundation / openvdb

OpenVDB - Sparse volume data structure and tools

OpenImagingLab / FlashVSR

[CVPR 2026] Towards Real-Time Diffusion-Based Streaming Video Super-Resolution — An efficient one-step diffusion framework for streaming VSR with locality-constrained sparse attention and a tiny conditional decoder.

dynamicslab / pysindy

A package for the sparse identification of nonlinear dynamical systems from data

decoderesearch / SAELens

Training Sparse Autoencoders on Language Models

NVIDIA / cuvs

cuVS - a library for vector search and clustering on the GPU

vdev-ctrl / Adaptive-Learnable-Hierarchical-Routing-

This repo is a alternative solution for standard self-attention. It uses tree routing with learnable functions for cheaper self-attention while not compromising accuracy.

DeepSeekV4Flash0731 / DeepSeek-V4-Flash-0731

DeepSeek V4 Flash 0731 - free deepseek v4 flash download, gguf, ollama, deepseek v4 pro 0813. deepseek v4 flash vs pro, benchmark, MoE, 1M context, compressed sparse attention, coding. CUDA/CPU, no API key, Windows local AI. Download:🡇

taichi-dev / taichi

Productive, portable, and performant GPU programming in Python.

infiniflow / infinity

The AI-native database built for LLM applications, providing incredibly fast hybrid search of dense vector, sparse vector, tensor (multi-vector), and full-text.

intel / neural-compressor

SOTA low-bit LLM quantization (INT8/FP8/MXFP8/INT4/MXFP4/NVFP4) & sparsity; leading model compression techniques on PyTorch, TensorFlow, and ONNX Runtime

NVIDIA / CUDALibrarySamples

CUDA Library Samples

castorini / pyserini

Pyserini is a Python toolkit for reproducible information retrieval research with sparse and dense representations.

TileDB-Inc / TileDB

The Universal Storage Engine

SeekStorm / SeekStorm

SeekStorm: vector & lexical search - in-process library & multi-tenancy server, in Rust.

cpmech / gosl

Linear algebra, eigenvalues, FFT, Bessel, elliptic, orthogonal polys, geometry, NURBS, numerical quadrature, 3D transfinite interpolation, random numbers, Mersenne twister, probability distributions, optimisation, differential equations.

DrTimothyAldenDavis / SuiteSparse

The official SuiteSparse library: a suite of sparse matrix algorithms authored or co-authored by Tim Davis, Texas A&M University.

owlbarn / owl

Owl - OCaml Scientific Computing @ https://ocaml.xyz

microsoft / MInference

[NeurIPS'24 Spotlight, ICLR'25, ICML'25] To speed up Long-context LLMs' inference, approximate and dynamic sparse calculate the attention, which reduces inference latency by up to 10x for pre-filling on an A100 while maintaining accuracy.

NVIDIA / raft

RAFT contains fundamental widely-used algorithms and primitives for machine learning and information retrieval. The algorithms are CUDA-accelerated and form building blocks for more easily writing high performance applications.

libxsmm / libxsmm

Library for specialized dense and sparse matrix operations, and deep learning primitives.

facontidavide / Bonxai

Fast, hierarchical, sparse Voxel Grid

ddemidov / amgcl

C++ library for solving large sparse linear systems with algebraic multigrid method

servo / rust-cssparser

Rust implementation of CSS Syntax Level 3

hypre-space / hypre

Parallel solvers for sparse linear systems featuring multigrid methods.

Evianis / travel-photo-abstraction

A source-available Codex skill for distilling photographs into sparse editorial abstractions.

HKUSTDial / flash-sparse-attention

Trainable fast and memory-efficient sparse attention

pydata / sparse

Sparse multi-dimensional arrays for the PyData ecosystem

sparsemat / sprs

sparse linear algebra library for rust

ginkgo-project / ginkgo

Numerical linear algebra software package

facebookresearch / mvdust3r

Open source impl of **MV-DUSt3R+ Single-Stage Scene Reconstruction from Sparse Views In 2 Seconds** from Meta Reality Labs. Project page https://mv-dust3rp.github.io/

thu-ml / SLA

SLA: Beyond Sparsity in Diffusion Transformers via Fine-Tunable Sparse–Linear Attention

conradsnicta / armadillo-code

Armadillo: fast C++ library for linear algebra (matrix maths) & scientific computing

elemental / Elemental

Distributed-memory, arbitrary-precision, dense and sparse-direct linear algebra, conic optimization, and lattice reduction

optimatika / ojAlgo

Pure Java LP, QP and MIP solvers plus fast linear algebra. Zero dependencies, MIT licensed. Mathematical optimization and linear algebra for the JVM.

veda-sparse / Veda-on-ComfyUI

Veda Sparse Attention for ComfyUI

canivel / dynolab

Dyno Lab — an AI safety, alignment and interpretability research workbench for Apple Silicon. Explore activations, probes, SAEs and interventions with local inference, a Python SDK, APIs and MCP.

Saganaki22 / ComfyUI-sol-attn

NVIDIA Sol-Attn for ComfyUI / Triton kernel on SM89 - SM121, with zero-copy MiniMax H3 nodes: memory-efficient attention, scheduled tau with graph preview, and feed-forward chunking. Measured 1.14–1.44× vs SageAttention and −37% MLP peak VRAM on H3

sepiablue-ai / ComfyUI-MiniMax-H3-W4A4-VSA

MiniMax H3 Ref2VA acceleration for ComfyUI on an RTX 4070 12GB: 4-bit FC1 weights + Streaming VSA sparse attention. 1024x1792 video with audio in about 3 min 17 s, about 3.4x faster than dense attention.

chenkangjie1123 / VGGT-Diff

Official implementation of the paper "VGGT-Diff: Visual Geometry Meets Diffusion for Sparse-View Novel View Synthesis."

InternLM / ResOPD

ResOPD: Tail Residualization for Sparse On-Policy Distillation. Core implementation built on verl.

Reederey87 / glm53-flash-exl3-2x-dgx-spark

GLM-5.3-Flash EXL3 (320B MoE) on 2x NVIDIA DGX Spark — production serving kit, 1M context, 97%+ multi-session prefix caching, DFlash2 spec decode

imdigitalashish / gpt-from-scratch

A single executed notebook building and training a small GPT with RoPE and a phase-aware sparse MoE experiment

veda-sparse / Miowtion

Sparse acceleration and LoRA fine-tuning of MiniMax-H3 on resource-constrained machines.

HaoyiZhu / Piecewise-Taylor-Attention

Piecewise-Taylor Attention

dodododddo / mcsparse

MC-Sparse: Deconstructing and Closing the Dense–Sparse Attention Gap in Diffusion Transformers.

tardellirs / gemma3moe-builder

Sparse-upcycle a dense Gemma-3-270m into a Mixture-of-Experts (gemma3moe) and serve it on llama.cpp (CPU). Upcycle, train, inspect routing, GGUF.

sepiablue-ai / ComfyUI-MiniMax-H3-TaoMate-C3

TaoMate-H3 3-step acceleration package for ComfyUI on an RTX 4070 12GB: 4-bit (W4A4) FFN weights, 10% sparse attention and extra INT8 weight caching, with Windows setup and sample workflows.

1999AZZAR / Blotcat-illustration

Generate quirky, hand-drawn 16:9 body text illustrations for English articles featuring Blotcat — a deadpan solid-black cat. Pure white background, sparse annotations, one structure per image.

rostamlabs / rostam

Open-source vector database and sub-microsecond key-value store in one Go engine — embed it as a library, run it standalone, or replicate it across a Raft cluster. HNSW/IVF/Vamana indexes, quantization, hybrid dense+sparse and BM25 search, WASM stored procedures. Apache-2.0.

YuuZhen / restrained-hand-drawn-illustration

11:00 Create playful, restrained hand-drawn illustrations from photos or prompts, featuring natural open contours, tactile variable-width lines, pale backgrounds, sparse muted color, JPG delivery, and optional GIF motion.

YilunKuang / lpworldmodel

Official Code for LpWM: A Case for Sparse Representations in World Models

extropic-ai / sparse-transformers

Sparse Transformers in JAX

aaalll12322 / ComfyUI-MiniMaxH3-SolAttn-V100

Sol-Attn (arXiv 2607.24027) sparse acceleration for MiniMax H3 on V100 — single-node ComfyUI plugin (embedded FP16Safe + keep-or-drop kernel)

fraunhoferhhi / RIPEpp

[LIMIT@ECCV 2026] RIPE, minus the negatives, plus a trainable matcher - full sparse matching pipelines learned from positive image pairs alone.