xerj-org / xerj
Local-first search engine and MCP server for AI agents. One Rust binary indexes code, docs, logs, JSONL/CSV and PDFs for BM25 full-text, vector and hybrid search, code search without grep, agent memory and RAG. Elasticsearch-compatible API; Corpus Hub serves hundreds of reference memory corpora.
BaruqueRodrigues / llm-legislativo
Corpus legislativo brasileiro em larga escala e modelo Transformer causal treinado do zero em PyTorch puro.
adbar / trafilatura
Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML
esbatmop / MNBVC
MNBVC(Massive Never-ending BT Vast Chinese corpus)超大规模中文语料集。对标chatGPT训练的40T数据。MNBVC数据集不但包括主流文化，也包括各个小众文化甚至火星文的数据。MNBVC数据集包括新闻、作文、小说、书籍、杂志、论文、台词、帖子、wiki、古诗、歌词、商品介绍、笑话、糗事、聊天记录等一切形式的纯文本中文数据。
larashero3-dotcom / lieflat-less-ai-tone
一个基于 283 万字语料统计的去 AI 味 skill · An AI-tone removal skill grounded in a 2.83-million-character corpus study
MontrealCorpusTools / Montreal-Forced-Aligner
Command line utility for forced alignment using Kaldi
Raudaschl / rag-fusion
RAG-Fusion: multi-query generation + Reciprocal Rank Fusion for better retrieval-augmented generation. Includes evaluation harness with NFCorpus/BEIR.
quanteda / quanteda
An R package for the Quantitative Analysis of Textual Data
center-for-threat-informed-defense / attack-flow
Attack Flow helps executives, SOC managers, and defenders easily understand how attackers compose ATT&CK techniques into attacks by developing a representation of attack flows, modeling attack flows for a small corpus of incidents, and creating visualization tools to display attack flows.
metasequoiaime / chinese-ime-lm
面向中文输入法的语言模型：语料、n-gram 统计、字级神经模型，以及判断它们好坏的评测集
EverMind-AI / SkillCorpus
Open-source infrastructure that turns scattered SKILL.md files into curated, retrieval-ready agent-skill corpora—with retrieval and evaluation tooling included.
adbar / German-NLP
Curated list of open-access/open-source/off-the-shelf resources and tools developed with a particular focus on German
AaronZ345 / GTSinger
Dataset and code of GTSinger(NeurIPS 2024 Spotlight): A Global Multi-Technique Singing Corpus with Realistic Music Scores for All Singing Tasks
storytold / photocraft-corpus
Test data for photocraft
Renhuai123 / nihai-tianji-corpus
倪海厦《天纪》结构化语料库 — 天纪全量 4886 条判语，十一册体系，112 单元约 61 小时讲课，每条带精确到秒的视频出处可回放溯源。已上线 metisziwei.com 三纪阁。姊妹库 nihai-renji-corpus（人纪六部）。语料 CC BY-NC-SA / 代码 MIT
misraj-ai / qalam
Arabic PDF text extraction that doesn't quietly corrupt your corpus: logical word order, base letters not presentation forms, ligatures intact and a per-page verdict telling you which pages genuinely need OCR. Rust + Python, no OCR.
OlegSotnikov / jc-rs
237 parsers that turn command output, file formats and strings into JSON, from one static Rust binary with no runtime to install. Verified against the full reference fixture corpus on every commit.
wheels344i-gte / ai-risk-map
A one-page reference for AI risk, built to widen the conversation before formal assessment. Organized by who owns the risk, with every factor traced to a source. Poster, workbook, CSV, and an AI-readable corpus. CC BY-SA 4.0.
LeqsNaN / RARG
Official code for the paper "A New Role for Relevance: Guiding Corpus Interaction in Agentic Search"
2046031muhammadjihad-crypto / chatty-lite
Simple AI Chatbot Builder 2026: Create Smart Conversational Bots Fast
LaplaceYoung / dsh-directorx
DirectorX as a DeepSeek Harness plugin: AI video/image/audio skills, knowledge corpus, and configurable vision/image/video/audio model tools.
lttxzmj / chinese-law-corpus
中国法律法规与案例结构化语料库：446 部法律/司法解释逐条 JSON（含效力状态）+ 278 指导性案例 + 445 公报案例，CC0
deepdave98 / postsmith
Writes LinkedIn and X posts in your voice from a corpus you supply.
fresnellll / AtlasNav
Persistent multi-view corpus navigation for evidence-efficient agentic search