Fish Audio Drama 3 text-to-speech on the TensorFold native CUDA engine for DGX Spark (GB10): recipe, engine patches, benchmarks. Built with Fish Audio.
Scale computer-use 2.0 with open-source drivers, cross-OS sandboxes, and benchmarks for training, evaluation, and data generation.
#1 Persistent memory for AI coding agents based on real-world benchmarks
๐ Token-Oriented Object Notation (TOON) โ compact, human-readable serialization of JSON data for LLM prompts. TypeScript SDK, CLI, benchmarks.
AFL++ is a state-of-the-art fuzzer, and #1 in benchmarks. It was originally based on AFL. Today it comes with qemu 5.1, collision-free coverage, enhanced laf-intel & redqueen, AFLfast++ power schedules, MOpt mutators, unicorn_mode, and a lot more!
Find the local LLM that actually runs and performs best on your hardware. Ranked by real, recency-aware benchmarks, not parameter count. One command, run it instantly.
A collection of awesome security hardening guides, tools and other resources
Open-source evaluation toolkit of large multi-modality models (LMMs), support 220+ LMMs, 80+ benchmarks
This is a Phi Family of SLMs book for getting started with Phi Models. Phi a family of open sourced AI models developed by Microsoft. Phi models are the most capable and cost-effective small language models (SLMs) available, outperforming models of the same size and next size up across a variety of language, reasoning, coding, and math benchmarks
โ
LLM-as-a-Verifier is a general-purpose framework that provides fine-grained feedback for any agent without requiring additional training. It achieves SOTA performance across coding, robotics, and medical agentic benchmarks.
Prime number projects in 100+ programming languages, to compare their speed - and their programmer's cleverness
A curated collection of papers, benchmarks, surveys, and tools for model quantization, covering low-bit networks, LLMs, multimodal and generative models, vector and lattice quantization, and efficient deployment.
VPS Fusion Monster โ Server Benchmark (Go Edition) Aims to be the most comprehensive and fastest server benchmarking project, built in Go with zero external dependencies. VPS ่ๅๆชๆๅกๅจๆต่ฏ้กน็ฎ ยท Go ็ๆฌ ่ดๅไบๆไธบๆๅ จ้ขๅๆๅฟซ้็ๆๅกๅจๆต่ฏ้กน็ฎ๏ผไฝฟ็จ Go ่ฏญ่จๅฎ็ฐ๏ผ้ถ็ฏๅขไพ่ตใ
AI API ไธญ่ฝฌ็ซ่ฏๆตๆ่กไธๅๆขๅทฅๅ ท๏ผๅฎๆตๅฏ็จ็ใๅปถ่ฟไธไปทๆ ผ ยท Open-source AI API relay benchmark, rankings & switcher for Claude Code / Codex
Serve large Qwen models fast on the GPUs you actually own. Qwen3.8-27B on a single 24 GB card with vLLM: 127 tok/s single-user (381 when the answer quotes the prompt), ~1,035 tok/s at 64 concurrent, 150k-262k context. vLLM patches, requant pipeline, benchmarks.
PerfKit Benchmarker (PKB) contains a set of benchmarks to measure and compare cloud offerings. The benchmarks use default settings to reflect what most users will see. PerfKit Benchmarker is licensed under the Apache 2 license terms. Please make sure to read, understand and agree to the terms of the LICENSE and CONTRIBUTING files before proceeding.
Open Source AI Accelerator Research Platform Standard / ๅผๆบๆจ็็ ็ฉถๅนณๅฐ
Production-grade C++ edge AI engine for video analytics and on-device VLM across Sophon, Rockchip RKNN, and x86, with visual orchestration, real-time OSD, events, and reproducible benchmarks.
An awesome list of Agent Harness engineering resources, including GitHub projects, tools, benchmarks, and practical guides.
Reference implementations of MLPerfยฎ training benchmarks
๐โโ๏ธ๐โโ๏ธ๐ JS minification benchmarks: babel-minify, esbuild, terser, uglify-js, swc, google closure compiler, tdewolff/minify, oxc-minify
Local Laya typed decisions on Apple Core ML and Neural Engine. Validated ports, ~5 ms short decisions on M3 Max, reproducible speed and energy benchmarks.
Easy and extensible benchmarking in Elixir providing you with lots of statistics!
The community's most comprehensive, continuously-updated index of research on Large Language Models for software vulnerability detection โ papers across function-level, repository-level, agentic, and smart-contract detection, plus datasets, benchmarks, and surveys.
Evaluate and improve models and agents using environments
Classifies GPUs based on their 3D rendering benchmark score allowing the developer to provide sensible default settings for graphically intensive applications.
Benchmarks for ASP.NET Core
A reading path for CPU performance engineering, from one instruction to production inference. Primary sources only, with a runnable benchmark for every section.
Fast, lightweight Firecrawl/Tavily alternative in Rust. Web scraper, crawler & search API with MCP server for AI agents. Drop-in Firecrawl-compatible API (/scrape, /crawl, /search). 2.3x faster than Tavily, 1.5x faster than Firecrawl in 1K-URL benchmarks. 6 MB RAM, single binary. Self-host or use managed cloud.
Agent memory for LLMs: 30 runnable Jupyter notebooks covering conversation buffers, vector stores, knowledge graphs, episodic and semantic memory, MemGPT, Mem0, Letta, Zep, Graphiti, LoCoMo benchmarks, and production patterns.
Model Zoo For OpenCV DNN and Benchmarks.
Mother of All BCI Benchmarks
TorchBench is a collection of open source benchmarks used to evaluate PyTorch performance.
Benchmarks for rust serialization frameworks
Jeff Geerling's SBC review data - Raspberry Pi, Radxa, Orange Pi, etc.
Performance tests and benchmarks
A curated, non-BS library of the best resources for building and evaluating AI agents โ papers, blogs, talks, tools, benchmarks. Maintained by BenchFlow.
Toolkit to run Python benchmarks
The hub for audio AI research: papers, open models, benchmarks & datasets across audio LLMs, speech recognition, TTS, music & audio generation.
This repository introduces PIXIU, an open-source resource featuring the first financial large language models (LLMs), instruction tuning data, and evaluation benchmarks to holistically assess financial LLMs. Our goal is to continually push forward the open-source development of financial artificial intelligence (AI).
๐ Benchmark Comparison of Packages with Runtime Validation and TypeScript Support
A curated research map of Recursive Self-Improvement (RSI): models, agents, harnesses, embodied systems, automated AI R&D, benchmarks, and safety.
Scala macros for compile-time generation of safe and ultra-fast JSON codecs + circe booster
HammerDB: The industry standard open-source database benchmark
This repo contains benchmarks used for testing the performance of all .NET Runtimes
A most Frontend Collection and survey of vision-language model papers, and models GitHub repository. Continuous updates.
Cut your AI coding agent's token bill on three axes: terse prose, YAGNI-first code, and tool-output compression. Claude Code, Pi, Cursor, Codex, Gemini + 4 more. Zero deps, published benchmarks including the runs it loses.
Curated systems, benchmarks, and papers etc. on memory for LLMs/MLLMs --- long-term context, retrieval, and reasoning.
A curated list of decision models (System One / typed decision models): hosted APIs, open-weight models, runtimes, SDKs, applications, benchmarks, and papers.
Collective Knowledge (CK), Collective Mind (CM/CMX) and MLPerf automations: community-driven projects to learn how to run AI, ML, and other emerging workloads more efficiently and cost-effectively across diverse models, datasets, software, and hardware using MLPerf methodology and benchmarks.
Fast and low overhead web framework fastify benchmarks
The wise choice for Ruby memoization
A unified framework for robot learning
[NeurIPS D&B '25] The one-stop repository for LLM unlearning
Latency benchmarks of Unix IPC mechanisms
Meta Agents Research Environments is a comprehensive platform designed to evaluate AI agents in dynamic, realistic scenarios. Unlike static benchmarks, this platform introduces evolving environments where agents must adapt their strategies as new information becomes available, mirroring real-world challenges.
Powerpipe: Dashboards for DevOps. Visualize cloud configurations. Assess security posture against a massive library of benchmarks. Build custom dashboards with code.
TUI and CLI for browsing models.dev, benchmarks, coding agents, and statuses for AI providers.
๐ฅ๐ฅ Awesome Jev: open-source models, projects, benchmarks, and independent evaluations for Jev and System One models.