agentscope-ai / agentscope

Build and run agents you can see, understand and trust.

OpenBMB / MiniCPM-V

See, hear, and interact on your local devices.

HKUDS / RAG-Anything

"RAG-Anything: All-in-One RAG Framework"

mlfoundations / open_clip

An open source implementation of CLIP.

TEN-framework / ten-framework

Open-source framework for conversational voice AI agents

modelscope / modelscope

ModelScope: bring the notion of Model-as-a-Service to life.

datajuicer / data-juicer

Data processing for and with foundation models! 🍎 🍋 🌽 ➡️ ➡️🍸 🍹 🍷

open-compass / VLMEvalKit

Open-source evaluation toolkit of large multi-modality models (LMMs), support 220+ LMMs, 80+ benchmarks

aurelio-labs / semantic-router

Superfast AI decision making and intelligent processing of multi-modal data.

Yuliang-Liu / Monkey

Monkey (LMM): Image Resolution and Text Label Are Important Things for Large Multi-modal Models (CVPR 2024 Highlight)

Kav-K / GPTDiscord

A robust, all-in-one GPT interface for Discord. ChatGPT-style conversations, image generation, AI-moderation, custom indexes/knowledgebase, youtube summarizer, and more!

autonomousvision / transfuser

[PAMI'23] TransFuser: Imitation with Transformer-Based Sensor Fusion for Autonomous Driving; [CVPR'21] Multi-Modal Fusion Transformer for End-to-End Autonomous Driving

InternLM / Intern-Decision

Fast multi-modal decision model

beryl09 / Explainable-Multi-Modal-Breast-Cancer-Prediction

—

ronitgupta138 / Vox-Intel-Engine

🎙️ Real-Time Multi-Modal Speech Telemetry & Acoustic DSP Engine (FastAPI, Python 3.11, Autocorrelation Pitch, FFT Spectral Energy & Lexical Pacing Analytics).

XinR-Tang / MMDiff

The Official Implementation of MMDiff: Multi-modal Remote Sensing Image Generation via Cross-Modality Spatial Feature Transfer