sumuru789 / DK-VLM
Official implementation for "DK-VLM: Geometry as Position for Spatial Reasoning in Vision-Language Models"
sumuru789 / DK-VLM
huggingface / transformers
๐ค Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.
hiyouga / LlamaFactory
Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)
bytedance / UI-TARS-desktop
The Open-Source Multimodal AI Agent Stack: Connecting Cutting-Edge AI Models and Agent Infra
sgl-project / sglang
SGLang is a high-performance serving framework for large language models and multimodal models.
RunanywhereAI / runanywhere-sdks
Production ready toolkit to run AI locally
StarTrail-org / PixelRAG
https://arxiv.org/abs/2606.28344. The end of web parsing. The beginning of scalable pixel-native search. link: https://pixelrag.ai/
OpenRLHF / OpenRLHF
An Easy-to-use, Scalable and High-performance Agentic RL Framework based on Ray (PPO & DAPO & REINFORCE++ & VLM & TIS & vLLM & Ray & Async RL)
roboflow / notebooks
A collection of tutorials on state-of-the-art computer vision models and techniques. Explore everything from foundational architectures like ResNet to cutting-edge models like RF-DETR, YOLO11, SAM 3, and Qwen3-VL.
oumi-ai / oumi
Easily fine-tune (SFT/RL), evaluate, and deploy Qwen, Gemma, or any open agentic LLM/VLM!
jingyaogong / minimind-v
๐ Train a 65M-parameter VLM from scratch in just 2h!
qualcomm / GenieX
Run frontier LLMs and VLMs locally on Qualcomm devices across NPU, GPU, and CPU with a few lines of code
OpenBMB / UltraRAG
A Low-Code MCP Framework for Building Complex and Innovative RAG Pipelines
Blaizzy / mlx-vlm
MLX-VLM is a package for inference and fine-tuning of Vision Language Models (VLMs) on your Mac using MLX.
xlite-dev / Awesome-LLM-Inference
๐A curated list of Awesome LLM/VLM Inference Papers with Codes: Flash-Attention, Paged-Attention, WINT8/4, Parallelism, etc.๐
EvolvingLMMs-Lab / lmms-eval
One-for-All Multimodal Evaluation Toolkit Across Text, Image, Video, and Audio Tasks
open-compass / VLMEvalKit
Open-source evaluation toolkit of large multi-modality models (LMMs), support 220+ LMMs, 80+ benchmarks
huggingface / smollm
Everything about the SmolLM and SmolVLM family of models
PaddlePaddle / FastDeploy
High-performance Inference and Deployment Toolkit for LLMs and VLMs based on PaddlePaddle
modelscope / evalscope
A streamlined and customizable framework for efficient large model (LLM, VLM, AIGC) evaluation and performance benchmarking.
xlang-ai / OSWorld
[NeurIPS 2024] OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments
radixark / miles
Miles is an enterprise-facing reinforcement learning framework for LLM and VLM post-training, forked from and co-evolving with slime.
jingyi0000 / VLM_survey
Collection of AWESOME vision-language models for vision tasks
lightseekorg / tokenspeed
TokenSpeed is a speed-of-light LLM inference engine.
om-ai-lab / OmAgent
[EMNLP-2024] Build multimodal language agents for fast prototype and production
zai-org / GLM-V
GLM-4.6V/4.5V/4.1V-Thinking: Towards Versatile Multimodal Reasoning with Scalable Reinforcement Learning
Achno / gowall
A tool to convert a Wallpaper's color scheme / palette, OCR with VLM's Traditional & Hybrid, Image Compression ,color palette extraction, image upsacling with Adversarial Networks and more image processing features.
Tencent-Hunyuan / HunyuanOCR
HunyuanOCR-1.5: Making Lightweight OCR VLMs Faster and Better
NVIDIA-AI-Blueprints / video-search-and-summarization
NVIDIA AI Blueprint for video search and summarization (VSS) is a GPU-accelerated reference architecture for building video analytics agents with real-time verified alerts, visual Q&A, and automated reporting. The VSS Blueprint uses vision language models (VLMs) such as NVIDIA Cosmos, LLMs such as NVIDIA Nemotron, RAG, and NVIDIA NIMs.
Thinklab-SJTU / Awesome-LLM4AD
A curated list of awesome LLM/VLM/VLA/World Model for Autonomous Driving(LLM4AD) resources (continually updated)
cosmo-wander-ai / cosmo-edge
Production-grade C++ edge AI engine for video analytics and on-device VLM across Sophon, Rockchip RKNN, and x86, with visual orchestration, real-time OSD, events, and reproducible benchmarks.
Core-Mate / OpenGUI
OpenGUI is an Android GUI agent framework for phone-use AI that can see, plan, and operate real mobile apps through the GUI.
om-ai-lab / VLX-Seek
VLX-Seek is an efficient VLM that grounds fine-grained visual targets with high precision in wild environments.
software-mansion / react-native-executorch
High-performance, privacy-first on-device AI inference library for React Native, powered by PyTorch's ExecuTorch runtime
Tencent / AngelSlim
Model compression toolkit engineered for enhanced usability, comprehensiveness, and efficiency.
yueliu1999 / Awesome-Jailbreak-on-LLMs
Awesome-Jailbreak-on-LLMs is a collection of state-of-the-art, novel, exciting jailbreak methods on LLMs. It contains papers, codes, datasets, evaluations, and analyses.
intel / auto-round
PTQ-Level Efficiency, QAT-Level Accuracy|่ฎญ็ปๅ้ๅ็ๆ็๏ผ้ๅๆ็ฅ่ฎญ็ป็็ฒพๅบฆ
intentee / paddler
Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale ๐๐ฆ Alternative to projects like llm-d, Docker Model Runner, etc but with less moving parts and simple deployments built around ggml ecosystem. Runs on CPU and GPU.
xLLM-AI / xllm
A high-performance inference engine for LLM, VLM, DiT and REC models, optimized for diverse AI accelerators. It is hosted in OpenAtom Foundation.
zhaochen0110 / Awesome_Think_With_Images
Resources and paper list for "Thinking with Images for LVLMs". This repository accompanies our survey on how LVLMs can leverage visual information for complex reasoning, planning, and generation.
wenet-e2e / wespeaker
Research and Production Oriented Speaker Verification, Recognition and Diarization Toolkit
peterdsharpe / AeroSandbox
Aircraft design optimization made fast through computational graph transformations (e.g., automatic differentiation). Composable analysis tools for aerodynamics, propulsion, structures, trajectory design, and much more.
TommyZihao / vlm_arm
ๆบๆขฐ่+ๅคงๆจกๅ+ๅคๆจกๆ=ไบบๆบๅไฝๅ ท่บซๆบ่ฝไฝ
kubeai-project / kubeai
AI Inference Operator for Kubernetes. The easiest way to serve ML models in production. Supports VLMs, LLMs, embeddings, and speech-to-text.
zai-org / CogAgent
An open-sourced end-to-end VLM-based GUI Agent
NVIDIA-NeMo / Automodel
๐ Pytorch Distributed native training library for LLMs/VLMs with OOTB Hugging Face support
daixiangzi / Awesome-Token-Compress
A paper list of some recent works about Token Compress for Vit and VLM
jjang-ai / vmlx
vMLX - Use MLX models easily - JANGQ (GGUF for MLX) - Not dependant on mlx_vlm
OpenDCAI / OpenWorldLib
Unified Codebase for Advanced World Models.
ml-explore / mlx-swift-lm
LLMs and VLMs with MLX Swift
Purewhiter / mobilegym
[EMNLP 2026] MobileGym: A Verifiable and Highly Parallel Simulation Platform for Mobile GUI Agent Research ยท ๆต่งๅจ้่ฟ่ก็ๅฎๅๆจกๆๅจ ยท Browser-hosted Android Simulator ยท Verifiable Evaluation ยท Scalable Online RL Training
OpenMOSS / MOSS-VL
An open-weight 11B model series for long-form and real-time video understanding
MigoXLab / dingo
Dingo: A Comprehensive AI Data, Model and Application Quality Evaluation Tool
FluxVLA / FluxVLA
An all-in-one VLA engineering platform for embodied AI โ from data to real-robot deployment.
TIGER-AI-Lab / VLM2Vec
This repo contains the code for "VLM2Vec / MMEB" [ICLR 2025], "VLM2Vec-V2 / MMEB-V2" [TMLR 2026], and "MMEB-V3" [COLM 2026]
baidu-baige / LoongForge
A high-performance framework for training LLMs, VLMs, diffusion, and embodied models on NVIDIA GPUs and Kunlun XPUs. Supports Pi0.5, GR00T-N1.7, FastWAM, Cosmos3, DreamZero, DeepSeek-V4, GLM-5.3, Kimi-K3 and more.
hybridgroup / yzma
Go with your own intelligence - Write Go applications that directly integrate llama.cpp for local inference using hardware acceleration on Linux, macOS, Windows, & WebAssembly.
huggingface / optimum-intel
๐ค Optimum Intel: Accelerate inference with Intel optimization tools
Fabric-Project / Fabric
Node Creative Coding / 3D / Image Processing tool inspired by Quartz Composer
RobotecAI / rai
RAI is a vendor agnostic agentic framework for Physical AI robotics, utilizing ROS 2 tools to perform complex actions, defined scenarios, free interface execution, log summaries, voice interaction and more.