Know Your Backend is a Plugin that help your AI to generate a structured Model/View/Controller application, witouth surprise, code duplication and different modality in a different project
A Comprehensive Guide for Generative AI, Agentic AI, Multimodal AI, Physical AI Interviews. Proven Formula for multiple FAANG offers and more
Official Code for OpenVLHarness: Real-World Visual Agentic ToolโUse with Multimodal Memory
๐ค Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.
Stop renting your intelligence. Own it with AnythingLLM. Everything you need for a powerful local-first agent experience
ใๆทฑๅ ฅ็่งฃ AI Agent๏ผ่ฎพ่ฎกๅ็ไธๅทฅ็จๅฎ่ทตใ๏ผๆๅๆฐ ่๏ผๅผๆบไธปไปๅบ๏ผๅ จไนฆๆญฃๆใ็ผ่ฏ็ PDF ไธๆ็ซ ้ ๅฅไปฃ็
A post-modern modal text editor.
The Open-Source Multimodal AI Agent Stack: Connecting Cutting-Edge AI Models and Agent Infra
SGLang is a high-performance serving framework for large language models and multimodal models.
Build and run agents you can see, understand and trust.
See, hear, and interact on your local devices.
Open-source AI orchestration framework for building context-engineered, production-ready LLM applications. Design modular pipelines and agent workflows with explicit control over retrieval, routing, memory, and generation. Built for scalable agents, RAG, multimodal applications, semantic search, and conversational systems.
"RAG-Anything: All-in-One RAG Framework"
Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities
YC (S26) | Open Computer History | Continuously record your company computer work, map your workflows, help you find work worth automating, and power your agents' context
Qwen3-VL is the multimodal large language model series developed by Qwen team, Alibaba Cloud.
A scalable generative AI framework built for researchers and developers working on Large Language Models, Multimodal, and Speech AI (Automatic Speech Recognition and Text-to-Speech)
โจ A beautiful, responsive, highly customizable and accessible (WAI-ARIA) replacement for JavaScript's popup boxes. Zero dependencies. ๐บ๐ฆ๐ช๐บ
:sparkles::sparkles:Latest Advances on Multimodal Large Language Models
Open Source framework for voice agents, multimodal apps, and realtime AI. Maintained by Daily and the community.
Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 600+ LLMs (Qwen3.8, DeepSeek-V4, GLM-5.1, InternLM3, Llama4, ...) and 300+ MLLMs (Qwen3-VL, Qwen3-Omni, InternVL3.5, Ovis2.5, GLM5.3, Gemma4, Llava, Phi4, ...) (AAAI 2025).
An open source implementation of CLIP.
YuE2: frontier music generation with symbolic planning, zero-shot covers, and agentic music editing.
๐ๅคงๆจกๅๅบ็จๅผๅๅฎๆไธ๏ผRAG ๆๆฏๅ จๆ ๆๅ๏ผๅจ็บฟ้ ่ฏปๅฐๅ๏ผhttps://datawhalechina.github.io/all-in-rag/
Developer-friendly OSS embedded retrieval library for multimodal AI. Search More; Manage Less.
Visualize, query, and stream to train on multimodal robotics data.
Open-source framework for conversational voice AI agents
mawww's experiment for a better code editor
X-AnyLabeling: A lightweight, efficient, and unified cross-platform desktop application for annotating text, image, video, point cloud and multimodal data, combining versatile built-in tools with state-of-the-art AI models and flexible multi-format export.
Production ready toolkit to run AI locally
https://arxiv.org/abs/2606.28344. The end of web parsing. The beginning of scalable pixel-native search. link: https://pixelrag.ai/
A framework to enable a multimodal model to operate a computer.
A Python library for anomaly detection across tabular, time series, graph, text, image, and audio data. 60+ detectors, benchmark-backed ADEngine orchestration, and an agentic workflow for AI agents.
AI powered open source recommender system engine supports classical/LLM rankers and multimodal content via embedding
SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.
Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop โ all through one unified, production-ready inference API.
ModelScope: bring the notion of Model-as-a-Service to life.
The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!
vxe table ๆฏๆ vue2, vue3 ็่กจๆ ผ่งฃๅณๆนๆก
FinRobot: An Open-Source AI Agent Platform for Financial Applications using Large Language Models
A text-to-speech (TTS), speech-to-text (STT) and speech-to-speech (STS) library built on Apple's MLX framework, providing efficient speech analysis on Apple Silicon.
Comprehensive production pipeline for quad-modal AI filmmaking with Seedance 2.0
A framework for efficient model inference with omni-modality models
Open Lakehouse Format for Multimodal AI. Convert from Parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckDB, Polars, Pyarrow, and PyTorch with more integrations coming..
Data processing for and with foundation models! ๐ ๐ ๐ฝ โก๏ธ โก๏ธ๐ธ ๐น ๐ท
AI suite powered by state-of-the-art models and providing advanced AI/AGI functions. Includes AI personas, AGI functions, world-class Beam multi-model chats, text-to-image, voice, response streaming, code highlighting and execution, PDF import, presets for developers, much more. Deploy on-prem or in the cloud.
Open-source framework for building agentic apps in JavaScript, Go, Dart, and Python, built and used in production by Google
Open Source Routing Engine for OpenStreetMap
High-performance data engine for AI and multimodal workloads. Process images, audio, video, and structured data at any scale
A Low-Code MCP Framework for Building Complex and Innovative RAG Pipelines
A modular framework for vision & language multimodal research from Facebook AI Research (FAIR)
๐ฎ Fast and full-featured autocomplete library
Search your computer by what's in your files: photos, PDFs, documents, recordings, videos and code. On-device on Mac, Windows and Linux, built on Google DeepMind's EmbeddingGemma 2.
A Next-Generation Training Engine Built for Ultra-Large MoE Models
A vi-like editor based on Plan 9's structural regular expressions
Lord of Large Language and Multi modal Systems Web User Interface
Plug in and Play Implementation of Tree of Thoughts: Deliberate Problem Solving with Large Language Models that Elevates Model Reasoning by atleast 70%
A comprehensive list of papers using large language/multi-modal models for Robotics/RL, including papers, codes, and related websites
The Ruby AI framework.
One-for-All Multimodal Evaluation Toolkit Across Text, Image, Video, and Audio Tasks