cocoindex-io / cocoindex
git clone https://github.com/cocoindex-io/cocoindex.git
v1.0.25 · 17d ago
Incremental engine for long horizon agents 🌟 Star if you like it!
+5
stars, 24h · #2,923
+~35
stars, 7 days · #3,551
+~150
stars, 30 days · #3,547
12k
★ total · +0% this week
921
forks · 108 open issues
Star history (as recorded here)
LanguageRust
LicenseApache-2.0
Created2025-03-03 (1y ago)
Last pushtoday
Watchers47
OwnerOrganization
GitHub topics
agentic-data-frameworkaiai-agentschange-data-capturecodebase-intelligencecontext-engineeringdata-engineeringdata-indexingdata-processingetlhelp-wantedindexingknowledge-graphllmlong-horizon-agentpythonragreal-timerustsemantic-search
Links
- GitHub: github.com/cocoindex-io/cocoindex
- Homepage: https://cocoindex.io
- Releases · Issues · Hacker News mentions
README excerpt
Your agents deserve fresh context. Star us ❤️ → · · · CocoIndex turns codebases, meeting notes, inboxes, Slack, PDFs, and videos into live, continuously fresh context for your AI agents and LLM apps to reason over effectively — with minimal incremental processing. Get your production AI agent ready in 10 minutes with reliable, continuously fresh data — no stale batches, no context gap Incremental · only the delta · Any scale · parallel by default · Declarative · Python, 5 min Deutsch | English | Español | français | 日本語 | 한국어 | Português | Русский | 中文 Built with CocoIndex ❤️ See all 20+ examples · updated every week → Get started [code] Declare *what* should be in your target — CocoIndex keeps it in sync forever, recomputing only the Δ. [code] Run once to backfill. Re-run anytime — only the changed files re-embed. Building with an AI coding agent? Drop in our CocoIndex skill so your agent writes correct v1 code — concepts, APIs, patterns, all in one file. See Use with AI coding agents for install steps. React — for data engineering See the React ↔ CocoIndex mental model → Incremental engine for long-horizon agents Data transformation for any engineer, designed for AI workloads — with a smart incremental engine for always-fresh, explainable data. Why incremental? Your agents are only as good as the data they see. Batch pipelines drift stale. CocoIndex stays live — and only runs the Δ. What can you build? See all 20+ examples · updated every week → Working starters from the examples tree — clone, plug your source, ship. Building something with CocoIndex? We want to see it. Tag @cocoindex_io on X or drop a link in #showcase on Discord. We'll boost it. 🥥 Community We are so excited to meet you. Every typo fix, new connector, doc tweak, or full-on rewrite makes CocoIndex better. Come hang out — big PRs and small ones, both welcome. 📝 Read the contributing guide · 🐛 good first issues · 💬 Say hi on Discord CocoIndex Enterprise Large corpus — built for enterprise scale. Incremental compute is the only way to keep large corpora fresh without re-embedding them every cycle. CocoIndex scales from a single repo to petabyte-scale stores — parallel by default, delta-only by design. Process once. Reconcile forever. When a source changes, CocoIndex identifies the affected records, propagates the change across joins and lookups, updates the target, and retires stale rows — without touching anything that didn't change. Built on a Rust engine. The core is Rust — production-grade from day zero. Parallel chunking, zero-copy transforms where possible, and failure isolation so one bad record doesn't stall the flow. Apache 2.0 · © CocoIndex contributors 🥥