Evolving Multimodal Inference Programs: LLM-guided evolutionary search for accurate and efficient vision-language inference.
SDK for robotics teams to verify the quality of their data used for AI model training.
[MobiSys 2026] A large-scale, multimodal dataset and benchmark for Human Action Recognition, Understanding and Reasoning
Verifiable handwriting synthesis for failure-driven multimodal training and regression.
LynnReal-Omni brings text-to-video, image-to-video, human- and hand-pose guided generation, structural control, omni-reference generation, style transfer, video editing, degraded-video restoration and streaming long-video generation into a single framework, all at four-step fast generation.
Local AI search for podcast and video archives on Apple Silicon: Whisper speech, Apple Vision OCR and SigLIP-2 visual search fused into one ranked list, with a trim editor and FCPXML export. FastAPI, vanilla JS, Tauri. Source-visible, all rights reserved.
PerceptionBench: Evaluating Atomic Visual Perception in Multimodal Large Language Models
Eyes are All JEV Needs - real time visual devisions from RGB, video and RGB-D cameras.
[NeurIPS 2026] Official code of "StreamPI: Streaming Multimodal Temporal Modeling for Vision-Language-Action Models"
Virtual filesystem overlay built on event streams for state replay and time travel
AgentGarten: Code Worlds for Evolving Agents
🚀🚀 A multimodal System One decision model that gives calibrated answers to typed questions about screens, photos, video and text in one forward pass.
S-Space: Exploring Spatial Workspace in Multimodal Models
🎬 OraRL — Annotations as Rollouts for efficient, scalable reinforcement learning of unified video MLLMs.
Unified AI API model catalog: machine-readable JSON for 300+ models behind one OpenAI-compatible API, with modality, billing unit, per-image, per-second and per-token pricing and doc links.
Real-event-anchored benchmark for detecting AI-generated videos in real-world crisis settings.
Evaluate visual models on your own images, JSON Schema, and production constraints with LangGraph, Pareto analysis, and a no-key Replay demo.
Official repository for “Shared Geometry As A Rosetta Stone: Cross-Modal Alignment Without Paired Data”
Open-source financial multimodal LLM for document understanding, chart/table reasoning, numerical reasoning, and financial analysis, with SFT, dual-branch RL, MOPD distillation, and public benchmark evaluation.
Auditable human-feedback annotation, review, provenance, and frozen training-data export.
🚀 Turn ideas and repositories into showcase-ready AI projects with agents, RAG, multimodal AI, local models, evals, safety checks, and polished demos.
Native-video memory for vision-language-action models, using timestamped visual history and exact streaming inference for long-horizon robot manipulation.
High-performance Lemonade alternative for AMD Strix Halo & Radeon — latest MoE models (Ling-3.0-Flash, Qwen 3.8 Flash Next, Ornith 1.5), bleeding-edge RDNA 3.5 Wave64/ROCmFP4 kernels, and silicon-tuned profiles.
A unified audio-video variational autoencoder with cross-modal alignment for joint reconstruction and generation
Know Your Backend is a Plugin that help your AI to generate a structured Model/View/Controller application, witouth surprise, code duplication and different modality in a different project
—
This repository provides a starter kit for sports intelligence built on NVIDIA AI stack: playbooks, training recipes, and inference for Multimodal Language Models.
Generate and review MiniMax H3 video prompts from user goals and multimodal references.
A collection and analysis of multimodal fake news datasets across languages, domains, platforms, and modalities.
Full-stack multimodal product retrieval and personalized reranking with CLIP, FAISS, Spring Boot, FastAPI, and PostgreSQL.
Self-hosted, private family AI health steward. Multimodal AI structures health data into a person-centric profile with dashboard & AI consultation (Feishu/Lark integration). 开源可私有化部署的家庭 AI 健康管家:多模态大模型 + 健康画像看板 + AI 咨询 + 飞书渠道。
Validated GLM-5.3 Flash recipe for 2x NVIDIA RTX PRO 6000 Blackwell 96GB: 262K context, EXL3/TR3, adaptive MTP, tools, and vision.
A causal reasoning world model for embodied intelligence, predicting future video through explicit chain-of-thought over motion and geometry with flexible multimodal conditioning.
An open System One decision model
Kunpeng-Skill is a powerful multimodal distillation toolkit that transforms high-value insights from repositories, websites, UIs, videos, images, and documents into reusable methodologies, model-agnostic regeneration specifications, and more.
An agent that edits your Word and Excel files — then looks at them, through real Microsoft Office, to check its own work
Seedance 2.5 API provider integration guide with multimodal content, model selection, async tasks, callbacks, errors, and Argolink mapping.
EmbeddingGemma2 resources: local search apps, decision models, inference frameworks, tutorials, and datasets. English / 简体中文.
Open Sensor-Language-Action (SLA) Models
🎙️ Real-Time Multi-Modal Speech Telemetry & Acoustic DSP Engine (FastAPI, Python 3.11, Autocorrelation Pitch, FFT Spectral Energy & Lexical Pacing Analytics).
ROS 2 and Isaac Sim reference stack for a mobile base with dual SO-101 arms, multimodal sensing, data QC, and imitation learning.
Multimodal prompt studio for ComfyUI. Write and refine prompts for image, video and audio models using local or API-based LLMs
ComfyUI MiniMax H3 全家桶:Unified to Video / Context IR / Multimodal Chat / Audio Lock / Media Loader / Resolution Selector / Concat AV 等 8 个节点,覆盖提示词优化到本地采样完整工作流
Local-first OCR-VLM multimodal document retrieval and independent evaluation prototype.
Open replica of TypeSafe's Jev: typed calibrated decisions in one forward pass, on Gemma 4 E2B / Gemma 3 270M (Modal)
Unified multimodal API documentation with compatible API examples, async image and video jobs, webhooks, uploads, model catalogs, and Argolink guides.
Zero-dependency local-first AI memory engine: graph memory, multimodal ingestion, reranking, temporal reasoning, hash-chained ledger, capsule compression, memory formation + runtime layers. 52 MCP tools (41 native + 11 compatible). MIT.
Long-term memory for AI coding agents (Claude Code, Codex, opencode) as a tree of plain files
Official code for InfoVis: one 9B model for slide image generation and editing, with the VisSlideBench benchmark and 15M+ training records.
The Official Implementation of MMDiff: Multi-modal Remote Sensing Image Generation via Cross-Modality Spatial Feature Transfer
A Fully Continuous Multimodal Flow Framework For Flexible Multimodal Sequence Modeling.
Turn videos and courses into evidence-grounded Agent Skills for Claude Code and Codex.
让任何 AI 真正"看"视频:纯本地的视频阅读 skill——faster-whisper GPU 转写 + ffmpeg 场景感知抽帧,双通道带时间戳(t=MM:SS),数据不出机。1 小时视频 3~5 分钟读完。Give any AI agent eyes for video: 100% local video-reading skill — faster-whisper GPU transcription + scene-aware ffmpeg frame extraction, dual-channel with t=MM:SS citations. Nothing leaves your machine.
HarnessIR: Harnessing Multimodal Foundation Models for Universal Real-World Image Restoration
Unified reproductions, benchmarking & evaluation for perception-aware RLVR and OPD in VLMs. 19 methods · 30+ benchmarks · Official code of CGPO (ACM MM 2026 Oral).
Curated, research-grade catalog of public AI models with substantial support for the Kazakh language.
MMOOC: A Comprehensive Benchmark for Out-of-Context Evaluation in Multimodal Large Language Models
Scientific paper figure generation Skill for agents: web research-figure conventions, controlled colour, topology planning, and image generation. 科研论文图生成 Skill:联网参考、配色与拓扑规划。
OpenAI-compatible reverse proxy for free multimodal AI APIs (chat / images / videos / audio / 3d)
A zero-dependency Python tool to resolve relative Markdown links and inline images as Base64 strings for RAG and Multimodal LLMs.