Open-source AI orchestration framework for building context-engineered, production-ready LLM applications. Design modular pipelines and agent workflows with explicit control over retrieval, routing, memory, and generation. Built for scalable agents, RAG, multimodal applications, semantic search, and conversational systems.
Convert documents to structured data effortlessly. Unstructured is open-source ETL solution for transforming complex documents into clean, structured formats for language models. Visit our website to learn more about our enterprise grade Platform product for production grade workflows, partitioning, enrichments, chunking and embedding.
Open-source inference server and production cluster for all the models your agent needs.
Weaviate is an open-source vector database that stores both objects and vectors, allowing for the combination of vector search with structured filtering with the fault tolerance and scalability of a cloud-native databaseβ.
Apache Lucene open-source search software
Private AI platform for agents, assistants and enterprise search. Built-in Agent Builder, Deep research, Document analysis, Multi-model support, and API connectivity for agents.
C++ library for audio and music analysis, description and synthesis, including Python bindings
cuVS - a library for vector search and clustering on the GPU
Open-source infrastructure that turns scattered SKILL.md files into curated, retrieval-ready agent-skill corporaβwith retrieval and evaluation tooling included.
π‘ All-in-one AI framework for semantic search, LLM orchestration and language model workflows
AdalFlow: The library to build & auto-optimize LLM applications.
Apache Solr open-source search software
List of software that allows searching the web with the assistance of AI: https://hf.co/spaces/felladrin/awesome-ai-web-search
Jev-powered relevance filtering and reranking for RAG in Python.
The code used to train and run inference with the ColVision models, e.g. ColPali, ColQwen2, and ColSmol.
Fast BM25 search in Python, powered by Numpy and Numba
Knowledge-graph RAG built from structured metadata instead of LLM extraction. 929M edges, zero LLM calls, 83.2% on held-out PubMedQA. Case study: the full PubMed 2026 baseline.
Harness LLMs with Multi-Agent Programming
Up to 100x faster strings for C, C++, CUDA, Python, Rust, Swift, JS, & Go, leveraging NEON, AVX2, AVX-512, SVE, GPGPU, & SWAR to accelerate search, hashing, sorting, edit distances, sketches, and memory ops π¦
MTEB: State-of-the-art evaluation of embeddings across languages and modalities
Highly Performant, Modular, Memory Safe and Production-ready Inference, Ingestion and Indexing built in Rust π¦
Fetches system/theme information in terminal for Linux desktop screenshots.
Pyserini is a Python toolkit for reproducible information retrieval research with sparse and dense representations.
Comprehensive and timely academic information on federated learning (papers, frameworks, datasets, tutorials, workshops)
SIMD-accelerated distances, dot products, matrix ops, geospatial & geometric kernels for 16 numeric types β from 6-bit floats to 64-bit complex β across x86, Arm, RISC-V, and WASM, with bindings for Python, Rust, C, C++, Swift, JS, and Go π
Information Gathering tool - DNS / Subdomains / Ports / Directories enumeration
Open CLI for integrating AI search, recommendation, and conversational retrieval into agent systems and business systems
PISA: Performant Indexes and Search for Academia
RAFT contains fundamental widely-used algorithms and primitives for machine learning and information retrieval. The algorithms are CUDA-accelerated and form building blocks for more easily writing high performance applications.
RAG-Fusion: multi-query generation + Reciprocal Rank Fusion for better retrieval-augmented generation. Includes evaluation harness with NFCorpus/BEIR.
MIDI / symbolic music tokenizers for Deep Learning models πΆ
AI-first Search & Answer Engine for work. Open-source alternative to Glean.
Minimalist web-searching platform with an AI assistant that runs directly from your browser. Demo: https://felladrin-minisearch.hf.space
Language model search engine built on a vector database and an anything key/value store.
AdalFlow Alternative 2026: Auto-Optimize LLM Apps Without Code
Build & Auto-Optimize LLM Apps in 2026: The Ultimate AdalFlow Guide
Zero downtime embedding upgrades
A full-featured search engine in Rust. Local filesystem + web crawl, BM25+PageRank ranking, BPE query language, bangs, Tor mode, HTTP/WebSocket API, and a privacy-first frontend.
Small System One decision models (17Mβ400M) for Yes/No, Choice, Score, and reranking. Training toolkit, Python inference, and ONNX support for Node.js and browsers.
An open-source interactive audio workstation that learns the harmonic structure of a sample library. Reflector absorbs your sound world and makes it navigable across sessions and individual arrangements.
Anserini is a Lucene toolkit for reproducible information retrieval research
FactCircuit: an auditable claim-and-evidence verification loop with immutable provenance, staged checks, bounded retrieval, and reproducible evaluation.
Discover new target domains using Content Security Policy
Research project on bilingual Urdu-English retrieval-augmented generation for Pakistani government and legal documents, with OCR, hybrid retrieval, citation grounding, and evaluation.
Self-hosted, traceable document-to-knowledge workspace with deterministic workflows, optional AI, search, RAG, and an editable knowledge graph.
Tools Are Not Islands: Set-Level Tool Retrieval for LLM Agents via Query-Conditioned Hyperedge Prediction