📈 GH Trending Explorer 🎲 Surprise me

Search: vision-language · clear

zigansh1n / imnotarobot

I am not a robot — a captcha solver for macOS: local model, Gemini vision, a stealth browser for checkbox captchas, RuCaptcha as the last resort. 2Captcha-compatible API and an MCP server.

▲ 50/7d ★ 50 Python 3d ago
groundingpi / GroundingPI

A 4B grounding foundation model for physical intelligence. Unifies detection, referring, pointing, OCR, GUI, and layout grounding, achieving SOTA overall across 34 benchmarks and improving robot generalization and data efficiency in controlled evaluations.

▲ ~49/7d ★ 155 Python 7d ago
PolyU-VCLab / OmniCompass

OmniCompass: A Holistic Benchmark for Omni-Modal Video Grounding and Understanding

▲ ~35/7d ★ 132 Python 2d ago
CVHub520 / X-AnyLabeling

X-AnyLabeling: A lightweight, efficient, and unified cross-platform desktop application for annotating text, image, video, point cloud and multimodal data, combining versatile built-in tools with state-of-the-art AI models and flexible multi-format export.

▲ ~28/7d ★ 11k Python 1d ago
datawhalechina / every-embodied

仅需Python基础,从0构建自己的具身智能机器人;从0逐步构建VLA/OpenVLA/SmolVLA/Pi0, 深入理解具身智能

▲ ~28/7d ★ 4.2k Python today
JethroJames / awesome-robots-icl

Companion repository for “In-Context Learning for Robots: Methods and Applications” — methods, datasets, and benchmarks organized by taxonomy and release date.

▲ ~28/7d ★ 132 Python today
sumuru789 / DK-VLM

Official implementation for "DK-VLM: Geometry as Position for Spatial Reasoning in Vision-Language Models"

▲ ~28/7d ★ 67 Python 6d ago
kyutai-labs / reki

REKI: a 2.4B vision-language-action model pretrained on public data only, with a memory of its recent past at negligible cost.

▲ 28/7d ★ 32 Python today
starVLA / starVLA

StarVLA: A Lego-like Codebase for Vision-Language-Action Model Developing

▲ ~21/7d ★ 3.8k Python 14d ago
Anionex / agent-vision-toolkit

为纯文本模型"看图“设计更好的视觉工具箱和技能,支持多图理解,图片问答,前端UI还原、GUI 自动化等,并可选无缝接入多个主流agent,直接识别粘贴图片| A vision toolkit and skill designed for text-only llms — image Q&A, long-screenshot OCR, frontend UI restoration, and GUI automation, with optional seamless integration for Codex, Claude Code, Pi, Oh My Pi, and OpenCode

▲ ~14/7d ★ 1.2k Python 8d ago
sou350121 / VLA-Handbook

本项目旨在为致力于进入VLA(Vision-Language-Action)领域的算法工程师提供一份全中文、实战导向的学习/面试手册。 不同于通用的 CV/NLP 面试指南,本项目聚焦于 Robotics 特有的挑战

▲ ~14/7d ★ 727 HTML today
robocurve / inspect-robots

Open source evals for physical AI. Run any LLM/VLA on any arm/humanoid against any real/sim benchmark.

▲ ~14/7d ★ 698 Python today
microsoft / AesCode

Aesthetic code generation with decoupled cross-modal rewards: turning prompts into editable, verifiable HTML/CSS infographics, with image generators as aesthetic guidance.

▲ ~14/7d ★ 118 Python 1d ago
off-grid-ai / OGAM

The Swiss Army Knife of Offline AI. Chat, see, speak, and generate images on your phone or Mac — GGUF LLMs, vision, Whisper speech-to-text, Stable Diffusion, tool calling, and local-network servers. Runs on your CPU, GPU, or NPU. No account, no API key, zero data leaves your device.

▲ ~7/7d ★ 3.3k TypeScript today
dexmal / opendm

An Open-World Foundation Model for General-Purpose Embodied Intelligence.

▲ ~7/7d ★ 2.2k Python 2d ago
waybarrios / vllm-mlx

High-performance OpenAI and Anthropic compatible LLM inference server for Apple Silicon. Native MLX, continuous batching, multimodal models, MCP tool calling, and Claude Code support.

▲ ~7/7d ★ 1.6k Python 1d ago
Anionex / dsh-vision-toolkit

[dsh]为纯文本模型设计更强大的视觉工具箱:一行安装使用、粘贴图片直接识别、多张图片问答、截图到前端UI 还原等|DeepSeek Harness-native integration for agent-vision-toolkit: image Q&A, long-screenshot OCR, UI restoration, grounding, pixel diff, Artifacts, and Web UI.

▲ ~7/7d ★ 902 TypeScript 4d ago
FluxVLA / FluxVLA

An all-in-one VLA engineering platform for embodied AI — from data to real-robot deployment.

▲ ~7/7d ★ 753 Python 3d ago
xiaomi-research / recogdrive

[ICLR 2026] ReCogDrive: A Reinforced Cognitive Framework for End-to-End Autonomous Driving

▲ ~7/7d ★ 626 Python 4d ago
QwenLM / Qwen-Drive-1.0

An Initial Step towards a Vision-Language Foundation Model for Autonomous Driving

▲ ~7/7d ★ 522 Python 1mo ago
MirroS-Lab / Code-as-World

Code as World: Agentic Discovery of Executable World Representations for Physical Reasoning

▲ ~7/7d ★ 423 Python 1mo ago
starVLA / VLAct

[NeurIPS 2026] Beyond Data Scaling: Representation-Centric Continued Pre-training for Vision-Language-Action Models

▲ ~7/7d ★ 147 Python 22d ago
DexForce / UNITAS

Official codebase for Unitas: A 3D-Native World Action Model for Embodied Manipulation

▲ ~7/7d ★ 97 Python 6d ago
groundingpi / GroundAnything

A 4B diffusion grounding model for fast, precise visual evidence extraction. Unifies diverse grounding tasks through parallel decoding, with optional self-speculative decoding delivering 4.51x autoregressive throughput on COCO.

▲ ~7/7d ★ 83 Python 7d ago
DAGroup-PKU / PyRUA-Lean

Fewer Tokens, Better Action: GPT-6 Astra Robot Agents with 14% Higher Success but 65% Fewer Tokens

▲ ~7/7d ★ 59 Python 1d ago
OmniJev / PlayJev

🚀🚀 A 0.8B JEV-like multimodal model playing GUI games directly from raw pixels.

▲ ~7/7d ★ 56 JavaScript 27d ago
Blaizzy / mlx-vlm

MLX-VLM is a package for inference and fine-tuning of Vision Language Models (VLMs) on your Mac using MLX.

▲ ~0/7d ★ 5.6k Python today
illuin-tech / colpali

The code used to train and run inference with the ColVision models, e.g. ColPali, ColQwen2, and ColSmol.

▲ ~0/7d ★ 2.8k Python 1mo ago
NVIDIA-AI-Blueprints / video-search-and-summarization

NVIDIA AI Blueprint for video search and summarization (VSS) is a GPU-accelerated reference architecture for building video analytics agents with real-time verified alerts, visual Q&A, and automated reporting. The VSS Blueprint uses vision language models (VLMs) such as NVIDIA Cosmos, LLMs such as NVIDIA Nemotron, RAG, and NVIDIA NIMs.

▲ ~0/7d ★ 1.9k Python today
Thinklab-SJTU / Awesome-LLM4AD

A curated list of awesome LLM/VLM/VLA/World Model for Autonomous Driving(LLM4AD) resources (continually updated)

▲ ~0/7d ★ 1.9k 6d ago
emcf / thepipe

Get clean data from tricky documents, powered by vision-language models ⚡

▲ ~0/7d ★ 1.5k Python 24d ago
zhaochen0110 / Awesome_Think_With_Images

Resources and paper list for "Thinking with Images for LVLMs". This repository accompanies our survey on how LVLMs can leverage visual information for complex reasoning, planning, and generation.

▲ ~0/7d ★ 1.5k 14d ago
thu-ml / Motus

Official code of Motus: A Unified Latent Action World Model

▲ ~0/7d ★ 1.3k Python 12d ago
DravenALG / awesome-vla-wam

A Curated List of Vision-Language-Action (VLA) and World Action Models (WAM) Research and Beyond

▲ ~0/7d ★ 1.1k today
OpenMOSS / MOSS-VL

An open-weight 11B model series for long-form and real-time video understanding

▲ ~0/7d ★ 780 C++ 8d ago
2toinf / X-VLA

[ICLR 2026] The offical Implementation of "Soft-Prompted Transformer as Scalable Cross-Embodiment Vision-Language-Action Model"

▲ ~0/7d ★ 746 C++ 2d ago
magicrew / doc7

Turn documents into AI-ready Markdown with visual understanding

▲ ~0/7d ★ 721 Go 2mo ago
H-EmbodVis / TurboVLA

TurboVLA: Real-Time Vision-Language-Action Model at 32 Hz on an RTX 4090 with <1 GB VRAM

▲ ~0/7d ★ 704 Python 12d ago
ginwind / VLA-JEPA

[ECCV 2026] VLA-JEPA: Enhancing Vision-Language-Action Model with Latent World Model

▲ ~0/7d ★ 617 Python 22d ago
wanshuiyin / ARIS-in-AI-Offer

Bilingual (中文+EN) ML / LLM / diffusion / agent interview cheat sheets for AI 秋招 — generated by ARIS /interview-cheatsheet, rendered by /render-html into single-file HTML, reads anywhere — plus a CV→DBLP-fact-checked academic homepage generator and hand-authored long-form blogs 🌱

▲ ~0/7d ★ 611 Python 4d ago
liudaizong / Awesome-LVLM-Attack

😎 up-to-date & curated list of awesome Attacks on Large-Vision-Language-Models papers, methods & resources.

▲ ~0/7d ★ 581 11d ago
Jiaaqiliu / Awesome-VLA-Robotics

A comprehensive list of excellent research papers, models, datasets, and other resources on Vision-Language-Action (VLA) models in robotics.

▲ ~0/7d ★ 501 3d ago
OpenMOSS / EasyWAM

A unified framework for training, fine-tuning, and evaluating World Action Models

▲ ~0/7d ★ 374 Python 3d ago
zzzz7788990213-ops / EvoVLM

Evolving Multimodal Inference Programs: LLM-guided evolutionary search for accurate and efficient vision-language inference.

▲ ~0/7d ★ 316 Python 20d ago
OmniJev / OneJev

🚀🚀 A multimodal System One decision model that gives calibrated answers to typed questions about screens, photos, video and text in one forward pass.

▲ ~0/7d ★ 182 Python today
MirroS-Lab / S-Space

S-Space: Exploring Spatial Workspace in Multimodal Models

▲ ~0/7d ★ 176 Python 9d ago
hku-sail / StreamPI

[NeurIPS 2026] Official code of "StreamPI: Streaming Multimodal Temporal Modeling for Vision-Language-Action Models"

▲ ~0/7d ★ 160 Python 25d ago
HVision-NKU / OraRL

🎬 OraRL — Annotations as Rollouts for efficient, scalable reinforcement learning of unified video MLLMs.

▲ ~0/7d ★ 159 Python 1mo ago

Load more →