RAI is a vendor agnostic agentic framework for Physical AI robotics, utilizing ROS 2 tools to perform complex actions, defined scenarios, free interface execution, log summaries, voice interaction and more.
EdgeRock: Strong Reasoning at Constant Memory. Multimodal models with O(N) generation and O(1) persistent history. Inference and evaluation code.
SDK libraries for Modal
A multimodal AI agent for geospatial data analysis and interactive visualization
Give AI agents eyes, ears, and verifiable results. Watch Skill turns video, audio and screen activity into searchable, timestamped evidence and proves work with deterministic contracts, not model opinion. DeepWatch is the agent workspace built on DeepSeek Harness. Python + npm, MCP, CLI, REST, Web.
Easy to use suite for designing a wide range of protein binder modalities.
MLX port of moonshotai/Kimi-K3 (2.78T multimodal MoE): streaming converter, REAP expert pruning, and per-language expert-overlap analysis
Multimodal MiniMax H3 prompt writer for ComfyUI with local and API providers.
Use local Qwen3.8-27B and official MiniMax-H3 Skills in ComfyUI to generate H3 prompts. Runs a standalone local llama-server , inference operates fully offline with no internet access.
[SIGGRAPH Asia 2026 (TOG)] PartLLM: A Unified Multimodal Foundation for 3D Part Segmentation
Standalone per-pin 12VHPWR overcurrent watchdog for ASUS ROG Astral GPUs. Shuts down your PC before the connector melts.
Open infrastructure for training, evaluating, and deploying System 1 decision models across language and multimodal backbones.
Claude skills for industry-standard Remotion motion graphics: klik-anim-bible (animation craft laws, standalone) + klik-remotion-method (end-to-end video production pipeline). Install one or both β see README.
CRAP: Cycloidal Reducer Algorithm & Parametrizer. Parametric cycloidal gearbox generator (build123d): give it bearings, motor, ratio and eccentricity; get collision-checked, toleranced STEP/STL parts and a live 3D web GUI.
Code for **"The Price of Consistency: Exploiting Visual Anchors for Multimodal Jailbreaking in Video Generation"** (ACM MM 2026).
β
Ultimate assistant for Helldivers 2. Features: God Mode, Infinite Ammo, Infinite Grenades, Infinite Stims, No Reload, Unlimited Stratagems, Super Credits & Medals Farm, Infinite Mission Timer, and more. 20+ functions.
Dohnuts builds small multimodal models for direct decisions. -> System One model
Open-source quantitative finance models in Python: option pricing and Greeks, volatility surfaces, deep hedging, portfolio construction and Monte Carlo. Every model runs on free data, with the full write-up on davidariasfinance.com
Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities
Open-source framework for conversational voice AI agents
A Python library for anomaly detection across tabular, time series, graph, text, image, and audio data. 60+ detectors, benchmark-backed ADEngine orchestration, and an agentic workflow for AI agents.
Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop β all through one unified, production-ready inference API.
ModelScope: bring the notion of Model-as-a-Service to life.
VoilΓ turns Jupyter notebooks into standalone web applications
A Low-Code MCP Framework for Building Complex and Innovative RAG Pipelines
A modular framework for vision & language multimodal research from Facebook AI Research (FAIR)
A Next-Generation Training Engine Built for Ultra-Large MoE Models
Lord of Large Language and Multi modal Systems Web User Interface
Awesome IoT. A collaborative list of great resources about IoT Framework, Library, OS, Platform
Plug in and Play Implementation of Tree of Thoughts: Deliberate Problem Solving with Large Language Models that Elevates Model Reasoning by atleast 70%
One-for-All Multimodal Evaluation Toolkit Across Text, Image, Video, and Audio Tasks
Open-source evaluation toolkit of large multi-modality models (LMMs), support 220+ LMMs, 80+ benchmarks
Superfast AI decision making and intelligent processing of multi-modal data.
Python port of Google's libphonenumber
Open-source multimodal retrieval engine (Morphik Core)
MTEB: State-of-the-art evaluation of embeddings across languages and modalities
Run Claude Code 100% on-device with local AI on Apple Silicon. MLX-native Anthropic-API server. 6 fighters incl. Muse-Glimmer 30B (now multimodal β reads images, abliterated), Gemma 4 31B, Qwen 3.5 122B (65 tok/s), DeepSeek V4 Flash (1M ctx). Private, offline, airgap-ready. Built for NDA / legal / healthcare workflows.
Tools to support converting a Python project into a standalone native application.
pg_activity is a top like application for PostgreSQL server activity monitoring.
The Context Layer for unstructured data: typed, versioned datasets over S3, GCS, Azure
Images to inference with no labeling (use foundation models to train supervised models).
streamline the fine-tuning process for multimodal models: PaliGemma 2, Florence-2, and Qwen2.5-VL
[EMNLP-2024] Build multimodal language agents for fast prototype and production
Rasterio reads and writes geospatial raster datasets
GLM-4.6V/4.5V/4.1V-Thinking: Towards Versatile Multimodal Reasoning with Scalable Reinforcement Learning
VeOmni: Scaling Any Modality Model Training with Model-Centric Distributed Recipe Zoo
GenAI Processors is a lightweight Python library that enables efficient, parallel content processing.
:superhero: :zap: django's default admin interface with superpowers - customizable themes, popup windows replaced by modals and many other features.
Extract structured data and insights from documents using LLMs and decision models
Monkey (LMM): Image Resolution and Text Label Are Important Things for Large Multi-modal Models (CVPR 2024 Highlight)
Implementation of "BitNet: Scaling 1-bit Transformers for Large Language Models" in pytorch
NVIDIA AI Blueprint for video search and summarization (VSS) is a GPU-accelerated reference architecture for building video analytics agents with real-time verified alerts, visual Q&A, and automated reporting. The VSS Blueprint uses vision language models (VLMs) such as NVIDIA Cosmos, LLMs such as NVIDIA Nemotron, RAG, and NVIDIA NIMs.
A robust, all-in-one GPT interface for Discord. ChatGPT-style conversations, image generation, AI-moderation, custom indexes/knowledgebase, youtube summarizer, and more!
WeMM-Embedding is a family of universal multimodal embedding models by the WeChat Vision Team at Tencent, supporting multimodal understanding and retrieval.
TorchMultimodal is a PyTorch library for training state-of-the-art multimodal multi-task models at scale.
Adala: Autonomous DAta (Labeling) Agent framework
The backend agents build with - Multimodal database, orchestration, and serving in one file
[PAMI'23] TransFuser: Imitation with Transformer-Based Sensor Fusion for Autonomous Driving; [CVPR'21] Multi-Modal Fusion Transformer for End-to-End Autonomous Driving
solo-learn: a library of self-supervised methods for visual representation learning powered by Pytorch Lightning