aicodeking / leanrea
One 8 KB skill that replaces REA (Reverse Engineer Anything): plain CLI tools, no MCP. Benchmarked: 38% faster, 35% cheaper.
aicodeking / leanrea
iha2 / superlite
A faster, leaner fork of the superpowers workflow for Claude Code: one approval gate, parallel waves, routed models. 3.9x faster in benchmark at equal quality.
apple-aiml-research / ml-rsi-inference-bench
A Long-Horizon Benchmark for Self-Improving Inference Systems
ozguradmin / ahenk-turkish-tts
Ahenk: aรงฤฑk Tรผrkรงe metinden sese. Open Turkish text-to-speech: VoxCPM2 LoRA (Ahenk), 8.6M on-device model (Ahenk Cep), trnorm text normaliser, TR-Zor benchmark
plotarmordev / drama-tensorfold
Fish Audio Drama 3 text-to-speech on the TensorFold native CUDA engine for DGX Spark (GB10): recipe, engine patches, benchmarks. Built with Fish Audio.
MemPalace / mempalace
The best-benchmarked open-source AI memory system. And it's free.
tirth8205 / code-review-graph
Local-first code intelligence graph for MCP and CLI. Builds a persistent map of your codebase so AI coding tools read only what matters, with benchmarked context reductions on reviews and large-repo workflows.
locustio / locust
Write scalable load tests in plain Python ๐๐จ
prowler-cloud / prowler
Prowler is the worldโs most widely used open-source cloud security platform that automates security and compliance across any cloud environment.
google / artemis
ARTEMIS turns natural-language instructions into reliable Android automation. It automates end-to-end workflows, captures logs, and integrates seamlessly with AI coding assistants such as Antigravity, Codex, and Claude Code. It also achieves 99%+ success rate on AndroidWorld Benchmark.
tigerless-labs / autoharness
Autoharness โ a self-learning skill layer for Claude Code โ distills skills from your real sessions, updates them as you work, and prunes the ones that stop getting used. No daemon, no benchmark.
yzhao062 / pyod
A Python library for anomaly detection across tabular, time series, graph, text, image, and audio data. 60+ detectors, benchmark-backed ADEngine orchestration, and an agentic workflow for AI agents.
open-compass / opencompass
OpenCompass is an LLM evaluation platform, supporting a wide range of models from OpenAI, Anthropic, Gemini, Qwen, GLM, DeepSeek, etc, across 100+ datasets covering knowledge, reasoning, coding, science, language, long-context, and safety.
Andyyyy64 / whichllm
Find the local LLM that actually runs and performs best on your hardware. Ranked by real, recency-aware benchmarks, not parameter count. One command, run it instantly.
EvolvingLMMs-Lab / lmms-eval
One-for-All Multimodal Evaluation Toolkit Across Text, Image, Video, and Audio Tasks
open-compass / VLMEvalKit
Open-source evaluation toolkit of large multi-modality models (LMMs), support 220+ LMMs, 80+ benchmarks
MichaelGrupp / evo
Python package for the evaluation of odometry and SLAM
devMEremenko / XcodeBenchmark
XcodeBenchmark measures the compilation time of a large codebase on iMac, MacBook, and Mac Pro
RUC-NLPIR / FlashRAG
โกFlashRAG: A Python Toolkit for Efficient RAG Research (WWW2025 Resource)
modelscope / evalscope
A streamlined and customizable framework for efficient large model (LLM, VLM, AIGC) evaluation and performance benchmarking.
embeddings-benchmark / mteb
MTEB: State-of-the-art evaluation of embeddings across languages and modalities
llm-as-a-verifier / llm-as-a-verifier
LLM-as-a-Verifier is a general-purpose framework that provides fine-grained feedback for any agent without requiring additional training. It achieves SOTA performance across coding, robotics, and medical agentic benchmarks.
xlang-ai / OSWorld
[NeurIPS 2024] OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments
OpenDCAI / DataFlex
[NeurIPS 2026] DataFlex: A Unified Benchmark and Evaluation Platform for Data-Centric Training of Large Language Models
RoboTwin-Platform / RoboTwin
[ICML 2026] RoboTwin 2.0 Offical Code Repo
EMI-Group / evox
Distributed GPU-Accelerated Framework for Evolutionary Computation. Comprehensive Library of Evolutionary Algorithms & Benchmark Problems.
yandex / yandex-tank
Load and performance benchmark tool
IBM / AssetOpsBench
AssetOpsBench - Industry 4.0: A unified benchmark and framework for building, orchestrating, and evaluating domain-specific AI agents for Industry 4.0 asset operations and maintenance, with 460+ scenarios, 5 specialist agents (IoT, FMSR, TSFM, Work Order,...), and multi-agent orchestration blueprints (MetaAgent, AgentHive) over MCP.
sierra-research / tau2-bench
ฯ-Bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains
syv-ai / HyperQwen
Serve large Qwen models fast on the GPUs you actually own. Qwen3.8-27B on a single 24 GB card with vLLM: 127 tok/s single-user (381 when the answer quotes the prompt), ~1,035 tok/s at 64 concurrent, 150k-262k context. vLLM patches, requant pipeline, benchmarks.
uber / ADR
ADR secures enterprise AI agents through observability, security benchmarking, and threat detection. Deployed at Uber.
elastic / rally
Macrobenchmarking framework for Elasticsearch
GoogleCloudPlatform / PerfKitBenchmarker
PerfKit Benchmarker (PKB) contains a set of benchmarks to measure and compare cloud offerings. The benchmarks use default settings to reflect what most users will see. PerfKit Benchmarker is licensed under the Apache 2 license terms. Please make sure to read, understand and agree to the terms of the LICENSE and CONTRIBUTING files before proceeding.
Farama-Foundation / Metaworld
Collections of robotics environments geared towards benchmarking multi-task and meta reinforcement learning
petergpt / bullshit-benchmark
BullshitBench measures whether AI models challenge nonsensical prompts instead of confidently answering them, created by Peter Gostev.
SemiAnalysisAI / InferenceX
Open Source AI Accelerator Research Platform Standard / ๅผๆบๆจ็็ ็ฉถๅนณๅฐ
Picrew / awesome-agent-harness
An awesome list of Agent Harness engineering resources, including GitHub projects, tools, benchmarks, and practical guides.
RoboVerseOrg / RoboVerse
RoboVerse: Towards a Unified Platform, Dataset and Benchmark for Scalable and Generalizable Robot Learning
Barca0412 / Introduction-to-Quantitative-Finance
AI+้่๏ผ้ๅ๏ผ๏ผ1.ๅคๅ ๅญ่ก็ฅจ้ๅๆกๆถๅผๆบๆ็จ 2.ๅญฆ็ๅไธ็็็ปๅ ธ่ตๆๆถๅฝ 3.AI + ้่็็ธๅ ณๅทฅไฝ๏ผๅ ๆฌLLM, Agent, benchmark(evaluation), etc.
mlcommons / training
Reference implementations of MLPerfยฎ training benchmarks
StanfordVL / BEHAVIOR-1K
BEHAVIOR-1K: a platform for accelerating Embodied AI research. Join our Discord for support: https://discord.gg/bccR5vGFEx
opendilab / LightZero
[NeurIPS 2023 Spotlight] LightZero: A Unified Benchmark for Monte Carlo Tree Search in General Sequential Decision Scenarios (awesome MCTS)
yoshitomo-matsubara / torchdistill
A coding-free framework built on PyTorch for reproducible deep learning studies. PyTorch Ecosystem. ๐26 knowledge distillation methods presented at TPAMI, CVPR, ICLR, ECCV, NeurIPS, ICCV, AAAI, etc are implemented so far. ๐ Trained models, training logs and configurations are available for ensuring the reproducibiliy and benchmark.
mizorewww / laya-coreml
Local Laya typed decisions on Apple Core ML and Neural Engine. Validated ports, ~5 ms short decisions on M3 Max, reproducible speed and energy benchmarks.
ninjahawk / livenerf
Benchmark for tracking model capability after release.
harveyai / harvey-labs
A benchmark built to evaluate and improve agent capabilities for supporting legal work.
huhusmang / Awesome-LLMs-for-Vulnerability-Detection
The community's most comprehensive, continuously-updated index of research on Large Language Models for software vulnerability detection โ papers across function-level, repository-level, agentic, and smart-contract detection, plus datasets, benchmarks, and surveys.
evo-hq / evo
turns your codebase into an autoresearch loop โ discovers what to measure, instruments the benchmark, then runs tree search with parallel subagents.
Topdu / OpenOCR
OpenOCR: An Open-Source Toolkit for General-OCR Research and Applications, integrates a unified training and evaluation benchmark, commercial-grade OCR and Document Parsing systems, and faithful reproductions of the core implementations from a wide range of academic papers.
sintel-dev / Orion
Unsupervised time series anomaly detection library
kengz / SLM-Lab
Modular Deep Reinforcement Learning framework in PyTorch. Companion library of the book "Foundations of Deep Reinforcement Learning".
LiveBench / LiveBench
LiveBench: A Challenging, Contamination-Free LLM Benchmark
NVIDIA-NeMo / Gym
Evaluate and improve models and agents using environments
chunxiaoxx / nautilus-compass
Open memory & reliability layer for AI agents + independent judging/verification (NACRE judge, caliber-bench meta-benchmark, preregistered criteria) โ by Nautilus Platform
zilliztech / VectorDBBench
Benchmark for vector databases.
Mibayy / token-savior
MCP server that gets Claude to 97.9% (188/192) on a real coding benchmark at -80% active tokens and -83% wall time, vs 78.3% plain. Structural code navigation + persistent memory engine. Works with every MCP client.
usamahz / cpu-performance-engineering
A reading path for CPU performance engineering, from one instruction to production inference. Primary sources only, with a runnable benchmark for every section.
opencv / opencv_zoo
Model Zoo For OpenCV DNN and Benchmarks.
TIGER-AI-Lab / ClawBench
Open-source benchmark for browser AI agents on daily tasks.
NeuroTechX / moabb
Mother of All BCI Benchmarks