📈 GH Trending Explorer 🎲 Surprise me

← all repos

groundingpi / GroundAnything

git clone https://github.com/groundingpi/GroundAnything.git

A 4B diffusion grounding model for fast, precise visual evidence extraction. Unifies diverse grounding tasks through parallel decoding, with optional self-speculative decoding delivering 4.51x autoregressive throughput on COCO.

+1
stars, 24h · #9,608
+~7
stars, 7 days · #10,256
+80
stars, 30 days · #6,363
83
★ total · +7% this week
12
forks · 3 open issues

Star history (as recorded here)

2026-10-20 · 79 ★ 2026-10-22 · 83 ★
LanguagePython
LicenseApache-2.0
Created2026-09-30 (22d ago)
Last push8d ago
Watchers1
OwnerUser

GitHub topics

Links

README excerpt
English | 简体中文 
 Reconciling Parallel Decoding with Precise Visual Grounding at Flash Speed 
 Demo Video · Quick Start · Documentation · Citation 
## 📰 News
- **2026-10-14:** GroundAnything and GroundAnything-VLM model weights are now available on ModelScope.
- **2026-10-14:** GroundAnything received strong community recognition, with **74 upvotes** on Hugging Face Daily Papers.
- **2026-10-04:** Released the project webpage.
- **2026-10-03:** Released the source code, deployment and batch-annotation guides, and full-suite evaluation workflows.
- **2026-10-01:** We released the GroundAnything and GroundAnything-VLM model weights on Hugging Face.
- **2026-09-30:** The GroundAnything paper is available on arXiv.
## 🧭 Contents
Highlights · Demo · Models · Installation · Deployment Options · Quick Start · vLLM Deployment · Batch Annotation · Tasks and Output Format · Method and Inference Infrastructure · Evaluation · Training · Results · Documentation · License · Citation · Acknowledgement
## ✨ Highlights
- **Unlocking diffusion for broad visual grounding.** We introduce GroundAnything, a 4B foundation model that unifies diverse grounding tasks with precise localization and parallel decoding, trained through grounding pretraining, AR-to-diffusion conversion with joint objectives, supervised fine-tuning, and GRPO-based reinforcement learning.
- **State-of-the-art grounding at 4B scale.** Across 30 benchmarks, GroundAnything surpasses the prior overall state of the art among similarly sized AR models and outperforms the larger Qwen3.7-Max. GroundAnything-VLM establishes a new overall state of the art at this scale and remains competitive with GPT-6 Astra.
- **Systematic acceleration studies.** We analyze decoding strategies in detail, compare with MTP-based generation, and evaluate progressive infrastructure optimizations for practical deployment.
## 🎬 Demo
▶ Watch the demo
▶ Parallel Decoding
## 🤗 Models
| Checkpoint | Generation | Download | Evaluation mode |
|:---|:---|:---|:---|
| **GroundAnything** | Entropy-guided diffusion; optional self-speculation | DLM weights | **GAM** |
| **GroundAnything-VLM** | Autoregressive generation | VLM weights | **GAM** |
GroundAnything's main results use entropy-guided decoding. GroundAnything-VLM is a separate autoregressive checkpoint. Both use the **GAM** evaluation mode.
## 🛠️ Installation
The serving workflows below target **Linux x86_64 and Python 3.12**. The serving setup installs the bundled custom **SGLang** engine and its pinned dependencies. The supplied serving profile uses Torch **2.9.1**, Transformers **5.5.4**, Triton **3.5.1**, sgl-kernel **0.3.20**, and FlashInfer **0.5.3**.
 [code] 
Already have a source checkout? Start with `cd GroundAnything`. Run subsequent commands from the repository root.
`requirements.txt` installs the lightweight HTTP client, visualization tools, and setup dependencies. Serving, training, and evaluation each use their own environment; `pip install -r requirements.txt` alo