sharkdp / hyperfine
A command-line benchmarking tool
sharkdp / hyperfine
locustio / locust
Write scalable load tests in plain Python ๐๐จ
tsenart / vegeta
HTTP load testing tool and library. It's over 9000!
winsiderss / systeminformer
A free, powerful, multi-purpose tool that helps you monitor system resources, debug software and detect malware. Brought to you by Winsider Seminars & Solutions, Inc. @ https://windows-internals.com
dotnet / BenchmarkDotNet
Powerful .NET library for benchmarking
flightlessmango / MangoHud
A Vulkan and OpenGL overlay for monitoring FPS, temperatures, CPU/GPU load and more.
codesenberg / bombardier
Fast cross-platform HTTP benchmarking tool written in Go
JoeDog / siege
Siege is an http load tester and benchmarking utility
nikolaydubina / go-recipes
๐ฆฉ Tools for Go projects
six-ddc / plow
A high-performance HTTP benchmarking tool that includes a real-time web UI and terminal display
modelscope / evalscope
A streamlined and customizable framework for efficient large model (LLM, VLM, AIGC) evaluation and performance benchmarking.
NVIDIA-NeMo / Switchyard
Switchyard lets LLM applications route traffic across models and providers while preserving native OpenAI and Anthropic API compatibility - enabling flexible model selection, benchmarking, and cost/performance optimization.
bojand / ghz
Simple gRPC benchmarking and load testing tool
xlang-ai / OSWorld
[NeurIPS 2024] OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments
phoronix-test-suite / phoronix-test-suite
The Phoronix Test Suite open-source, cross-platform automated testing/benchmarking software.
Lifelong-Robot-Learning / LIBERO
Benchmarking Knowledge Transfer in Lifelong Robot Learning
oneclickvirt / ecs
VPS Fusion Monster โ Server Benchmark (Go Edition) Aims to be the most comprehensive and fastest server benchmarking project, built in Go with zero external dependencies. VPS ่ๅๆชๆๅกๅจๆต่ฏ้กน็ฎ ยท Go ็ๆฌ ่ดๅไบๆไธบๆๅ จ้ขๅๆๅฟซ้็ๆๅกๅจๆต่ฏ้กน็ฎ๏ผไฝฟ็จ Go ่ฏญ่จๅฎ็ฐ๏ผ้ถ็ฏๅขไพ่ตใ
tinylibs / tinybench
๐ A simple, tiny and lightweight benchmarking library!
uber / ADR
ADR secures enterprise AI agents through observability, security benchmarking, and threat detection. Deployed at Uber.
elastic / rally
Macrobenchmarking framework for Elasticsearch
phpbench / phpbench
PHP Benchmarking framework
RRZE-HPC / likwid
Performance monitoring and benchmarking suite
Farama-Foundation / Metaworld
Collections of robotics environments geared towards benchmarking multi-task and meta reinforcement learning
SemiAnalysisAI / InferenceX
Open Source AI Accelerator Research Platform Standard / ๅผๆบๆจ็็ ็ฉถๅนณๅฐ
AhmadHassan-BTed / Ledgerify
Shopify Excel Ledger intelligence platform with dark aesthetic, multi-sheet workbook analysis, 7 departmental dashboards, and live comparative benchmarking.
decisionintelligence / TFB
[PVLDB 2024 Best Paper Nomination] TFB: Towards Comprehensive and Fair Benchmarking of Time Series Forecasting Methods
gradle / gradle-profiler
A tool for gathering profiling and benchmarking information for Gradle builds
bencheeorg / benchee
Easy and extensible benchmarking in Elixir providing you with lots of statistics!
timescale / tsbs
Time Series Benchmark Suite, a tool for comparing and evaluating databases for time series data
sintel-dev / Orion
Unsupervised time series anomaly detection library
Accio-org / CommerceAgentBench
CommerceAgentBench: Benchmarking Long-Horizon Agents in High-Fidelity, Stateful, and Reproducible Replicas of Real Online Services
BoringBoredom / PC-Optimization-Hub
collection of various resources devoted to performance and input lag optimization
inikep / lzbench
lzbench is an in-memory benchmark of open-source compressors
dotnet / crank
Benchmarking infrastructure for applications
redis / memtier_benchmark
NoSQL Redis and Memcache traffic generation and benchmarking tool.
airspeed-velocity / asv
Airspeed Velocity: A simple Python benchmarking tool with web-based reporting
patchy631 / time-to-first-token
A 10-week, 30-minutes-a-day roadmap for LLM inference serving and optimization. vLLM, SGLang, quantization, speculative decoding, benchmarking.
psf / pyperf
Toolkit to run Python benchmarks
NVIDIA / nvbench
CUDA Kernel Benchmarking Library
bencherdev / bencher
๐ฐ Bencher - Continuous Benchmarking
rsasaki0109 / lidar_slam_ros2
ROS 2 LiDAR SLAM for pointcloud-map authoring, benchmarking, and Autoware-compatible map workflows.
minio / warp
S3 benchmarking tool
google / caliper
Deprecated micro-benchmarking library for Java
DocAILab / XRAG
XRAG: eXamining the Core - Benchmarking Foundational Component Modules in Advanced Retrieval-Augmented Generation
ai-dynamo / aiperf
AIPerf is a comprehensive benchmarking tool that measures the performance of generative AI models served by your preferred inference solution.
aliesbelik / awesome-jmeter
A collection of resources covering different aspects of JMeter usage.
TPC-Council / HammerDB
HammerDB: The industry standard open-source database benchmark
melix / jmh-gradle-plugin
Integrates the JMH benchmarking framework with Gradle
JuliaCI / BenchmarkTools.jl
A benchmarking framework for the Julia language
ServiceNow / AgentLab
AgentLab: An open-source framework for developing, testing, and benchmarking web agents on diverse tasks, designed for scalability and reproducibility.
mlcommons / ck
Collective Knowledge (CK), Collective Mind (CM/CMX) and MLPerf automations: community-driven projects to learn how to run AI, ML, and other emerging workloads more efficiently and cost-effectively across diverse models, datasets, software, and hardware using MLPerf methodology and benchmarks.
Kotlin / kotlinx-benchmark
Kotlin multiplatform benchmarking toolkit
IPNL-POLYU / UrbanNavDataset
UrbanNav:An Open-sourced Multisensory Dataset for Benchmarking Positioning Algorithms Designed for Urban Areas
SalesforceAIResearch / MCP-Universe
MCP-Universe is a comprehensive framework designed for RL training, benchmarking, and developing AI agents for general tool-use.
pigirons / cpufp
A CPU tool for benchmarking the peak of floating points
NVlabs / RoboLab
A simulation benchmarking platform for evaluating generalist robot policies
daanx / mimalloc-bench
Suite for benchmarking malloc implementations.
itbench-hub / ITBench
An open source benchmarking framework for IT automation
ktwu01 / benchmark-radar
Track 33,707+ AI benchmark, eval, dataset, and data-quality records from 40 public sources, with linked evidence and daily updates.
Simreal-AI / Simreal-MLBench
[Public preview] Externally scored agentic ML research benchmark: 60 tasks, real competition ground truth. Open protocol, operated evaluation.