MadsLorentzen / ai-job-search

The job search that runs on your machine. AI job application framework built on Claude Code: evaluate postings, tailor CVs, write cover letters, prep interviews. Fork it and own it.

ifixai-ai / iFixAi

Independent Auditing of AI Agents. Run by human or the agent itself, to answer the most crucial question in the AI Agent Economy. Is the agent doing what is supposed to do? With iFixAi you can have this answer in less than 120 seconds.

cdcailf / cjkfold

Fold look-alike CJK glyphs (Kangxi radicals, CJK radical supplements) so text extracted from PDFs matches again.

Dong-Fang-Bu-Bai / btr-dualrag

Source code for BTR-dualRAG: Bioinformatics Tool Recommendation With Dual Retrieval-Augmented Generation

Aoisop / mawoagent

An auditable, reversible, evaluable local agent runtime that turns feedback into skills — and ships them only when evidence and tests say so.

FirmwareVersion / choravox

Offline multi-speaker meeting-speech toolkit: planted-ground-truth synthetic meeting factory, VAD, speaker embeddings, diarization (AHC/spectral/VB-HMM), overlap detection, CTC speaker-attributed ASR, cpWER/DER/JER evaluation, online streaming mode, deterministic reports. NumPy core, CPU-only torch extra.

pathwaycom / serviette

A no-code RAG server that keeps answers in sync with your documents. Works with 8 vector databases. Built on Pathway.

HKUDS / LightRAG

[EMNLP2025] LightRAG: Simple and Fast Retrieval-Augmented Generation

VectifyAI / PageIndex

📑 PageIndex: Document Index for Vectorless, Reasoning-based RAG

huggingface / pytorch-image-models

The largest collection of PyTorch image encoders / backbones. Including train, eval, inference, export scripts, and pretrained weights -- ResNet, ResNeXT, EfficientNet, NFNet, Vision Transformer (ViT), MobileNetV4, MobileNet-V3 & V2, RegNet, DPN, CSPNet, Swin Transformer, MaxViT, CoAtNet, ConvNeXt, and more

microsoft / graphrag

A modular graph-based Retrieval-Augmented Generation (RAG) system

onyx-dot-app / onyx

Open Source AI Platform - AI Chat with advanced features that works with every LLM

oraios / serena

A powerful MCP toolkit for coding, providing semantic retrieval and editing capabilities - the IDE for your agent

mlflow / mlflow

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

deepset-ai / haystack

Open-source AI orchestration framework for building context-engineered, production-ready LLM applications. Design modular pipelines and agent workflows with explicit control over retrieval, routing, memory, and generation. Built for scalable agents, RAG, multimodal applications, semantic search, and conversational systems.

HKUDS / RAG-Anything

"RAG-Anything: All-in-One RAG Framework"

comet-ml / opik

Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.

google / adk-python

An open-source, code-first Python toolkit for building, evaluating, and deploying sophisticated AI agents with flexibility and control.

huggingface / sentence-transformers

State-of-the-Art Embeddings, Retrieval, and Reranking

confident-ai / deepeval

The LLM Evaluation Framework

arc53 / DocsGPT

Private AI platform for agents, assistants and enterprise search. Built-in Agent Builder, Deep research, Document analysis, Multi-model support, and API connectivity for agents.

llmware-ai / llmware

Unified framework for building enterprise RAG pipelines with small, specialized models

ShishirPatil / gorilla

Gorilla: Training and Evaluating LLMs for Function Calls (Tool Calls)

StarTrail-org / LEANN

[MLsys2026 Best Paper]: https://arxiv.org/abs/2506.08276. RAG on Everything with LEANN. Enjoy 97% storage savings while running a fast, accurate, and 100% private RAG application on your personal device.

neuml / txtai

💡 All-in-one AI framework for semantic search, LLM orchestration and language model workflows

simular-ai / Agent-S

Agent S: an open agentic framework that uses computers like a human

dataelement / bisheng

BISHENG is an open LLM devops platform for next generation Enterprise AI applications. Powerful and comprehensive features include: GenAI workflow, RAG, Agent, Unified model management, Evaluation, SFT, Dataset Management, Enterprise-level System Management, Observability and more.

Arize-ai / phoenix

AI Observability & Evaluation

pathwaycom / arc-task-gen

Generates original ARC-AGI-1-style tasks distribution-matched to the public eval set.

NVIDIA / garak

the LLM vulnerability scanner

oumi-ai / oumi

Easily fine-tune (SFT/RL), evaluate, and deploy Qwen, Gemma, or any open agentic LLM/VLM!

LearningCircuit / local-deep-research

~95% on SimpleQA (e.g. Qwen3.6-27B on a 3090). Supports all local and cloud LLMs (llama.cpp, Ollama, Google, ...). 10+ search engines - arXiv, PubMed, your private documents. Everything Local & Encrypted.

Azure-Samples / azure-search-openai-demo

A sample app for the Retrieval-Augmented Generation pattern running in Azure, using Azure AI Search for retrieval and Azure OpenAI large language models to power ChatGPT-style and Q&A experiences.

open-compass / opencompass

OpenCompass is an LLM evaluation platform, supporting a wide range of models from OpenAI, Anthropic, Gemini, Qwen, GLM, DeepSeek, etc, across 100+ datasets covering knowledge, reasoning, coding, science, language, long-context, and safety.

interviewstreet / hiring-agent

AI agent to evaluate and score resumes.

Tencent / AI-Infra-Guard

A full-stack AI Red Teaming platform securing AI ecosystems via Agent Scan, Skills Scan, MCP scan, AI Infra scan and LLM jailbreak evaluation.

harbor-framework / harbor

Framework for evaluating and improving agents

MinishLab / semble

Fast and Accurate Code Search for Agents. Uses 99% fewer tokens than grep+read

Q00 / ouroboros

Agent OS: the agent gets smarter on its own. We just hold the line: Interview-gated, staged evaluation, budgeted evolution loop. MCP server, 14 runtimes: Claude Code, Codex CLI, Gemini CLI, OpenCode, Copilot, Kiro and more.

google / agents-cli

The CLI and skills that turn any coding assistant into an expert at creating, evaluating, and deploying AI agents on Google Cloud.

Giskard-AI / giskard-oss

🐢 Open-Source Evaluation & Testing library for LLM Agents

PaddlePaddle / PaddleClas

A treasure chest for visual classification and recognition powered by PaddlePaddle

vitali87 / code-graph-rag

The ultimate RAG for your monorepo. Query, understand, and edit multi-language codebases with the power of AI and knowledge graphs

Kiln-AI / Kiln

Build, Evaluate, and Optimize AI Systems. Includes evals, RAG, agents, fine-tuning, synthetic data generation, dataset management, MCP, and more.

transformerlab / transformerlab-app

The open source research environment for AI researchers to seamlessly train, evaluate, and scale models from local hardware to GPU clusters.

rafaelpadilla / Object-Detection-Metrics

Most popular metrics used to evaluate object detection algorithms.

ai-boost / awesome-harness-engineering

Awesome list for AI agent harness engineering: tools, patterns, evals, memory, MCP, permissions, observability, and orchestration.

feyninc / chonkie

🦛 CHONK docs with Chonkie ✨ — The lightweight ingestion library for fast, efficient and robust RAG pipelines

pytorch / ignite

High-level library to help with training and evaluating neural networks in PyTorch flexibly and transparently.

Jia-Ethan / codex-keysmith

Versioned Codex instruction deployment with preview, ownership manifests, hook isolation, scenario evaluation, and recovery.

PrimeIntellect-ai / verifiers

Our library for RL environments + evals

langflow-ai / openrag

OpenRAG is a comprehensive, single package Retrieval-Augmented Generation platform built on Langflow, Docling, and Opensearch.

pydantic / logfire

AI observability platform for production LLM and agent systems.

EvolvingLMMs-Lab / lmms-eval

One-for-All Multimodal Evaluation Toolkit Across Text, Image, Video, and Audio Tasks

layumi / Person_reID_baseline_pytorch

:bouncing_ball_person: Pytorch ReID: A tiny, friendly, strong pytorch implement of person re-id / vehicle re-id baseline. Tutorial 👉https://github.com/layumi/Person_reID_baseline_pytorch/tree/master/tutorial

open-compass / VLMEvalKit

Open-source evaluation toolkit of large multi-modality models (LMMs), support 220+ LMMs, 80+ benchmarks

MichaelGrupp / evo

Python package for the evaluation of odometry and SLAM

tigerless-labs / agent-memory

Long-term memory runtime for AI agents — plain Markdown as the source of truth, local ranked retrieval, and an independent sleep-time Manage layer. Claude Code and Codex share one store. No API key.

langroid / langroid

Harness LLMs with Multi-Agent Programming

TarrySingh / Artificial-Intelligence-Deep-Learning-Machine-Learning-Tutorials

Synapsa Commons: free, hands-on AI courses that run anywhere (Colab, Kaggle, Binder, Codespaces, Jupyter). EU AI Act conformity evidence, model validation, predictive maintenance, document extraction, retrieval and RAG, AI agents and MCP, a simulated humanoid. Every lesson autograded. From the team building Synapsa.