Python CLI and agent plugin that audits whether an AI agent does the job it is supposed to do, using adversarial and operational tests.
Real-time HFT bot for Polymarket crypto Up/Down markets combining CLOB order books, Chainlink feeds and multi-exchange prices with TWAP and Black-Scholes probability models; paper mode and backtests.
Stealth Chromium that passes every bot detection test. Drop-in Playwright replacement with source-level fingerprint patches. 50+ tests passed.
An auditable, reversible, evaluable local agent runtime that turns feedback into skills — and ships them only when evidence and tests say so.
Agent skill that turns natural language, code, Terraform/K8s, SQL, OpenAPI, AsyncAPI, Protobuf and GraphQL sources into editable, tested draw.io architecture diagrams: incremental sync, multi-view projection, drift diff, CI architecture tests, whiteboard derasterize, interactive HTML/PPTX/Mermaid exports.
Perturb-and-continue causal tests of chain-of-thought: does the written reasoning actually constrain the answer? Code, data, and probes for "From Decorative to Load-Bearing: Task Difficulty Shapes the Causal Role of Chain-of-Thought" (TMLR 2026).
The pytest framework makes it easy to write small tests, yet scales to support complex functional testing
Trace-native CI/CD for AI agents: grade production traces, cluster failures, freeze them into replayable regression tests, and block PRs that regress. Self-hostable.
A Python/Pandas ETL pipeline that turns a deliberately messy automotive dataset into production-ready data, with 15 pytest tests and GitHub Actions CI.
AI agents that actually place the trade. 12 brokers, real backtests, stocks options futures forex crypto and prediction markets.
See what your coding agents did and what it cost. Breaks each task down into work steps — tools used, files changed, tests run, time and tokens spent. Local-first dashboard for Claude Code, Codex, OpenCode, and more. No login, no telemetry.
Agentic quant research workbench with CSV data inspection, local Codex and compatible APIs, predictive models, independent reviews, and reproducible backtests.
Write scalable load tests in plain Python 🚗💨
Windows GUI Automation with Python (based on text properties)
MCP server for market analysis in AI assistants: screeners, multi-timeframe technical analysis, backtests and sentiment for crypto, stocks, forex and futures. 39 tools. Self-host free, or use the hosted version, TradingMCP.
Data Contracts engine for the modern data stack. https://www.soda.io
DSH Plugin Radar — open-source ecosystem radar for DeepSeek Harness plugins: continuous discovery (21k+ candidates), k8s runtime validation (13k+ tests), 15-min snapshots; the catalog is a generated artifact — 开源 DSH 插件生态雷达:持续发现 2.1 万+ 候选、k8s 运行级实测 1.3 万+、15 分钟快照;插件目录为自动生成的产物
inline-snapshot boosts efficiency when writing tests by generating code with the expected values and simplifies snapshot tests with pytest.
Lightweight, rule-based checks for missing, weak, and uncovered tests in pull requests.
Deterministic Clash Royale simulator and a reinforcement-learning agent for 2.6 Hog Cycle. Integer-exact physics from client data, 1,600+ tests.
Claude skill that turns a book (EPUB, PDF, HTML, DOCX, Markdown) into an interactive beginner-friendly course: step-by-step lessons, animations, quizzes, chapter tests, flashcards and coding exercises checked by unit tests, with progress saved to files. Runs in the browser, or packaged as an Android APK or a Linux AppImage.
Always know what to expect from your data.
A library that allows you to easily mock out tests based on AWS infrastructure.
Asynchronous Python framework for event-driven services. A thin client for Kafka, RabbitMQ, NATS, Redis and MQTT with full access to native broker features, plus AsyncAPI docs, in-memory tests and observability out of the box.
The OWASP MASVS (Mobile Application Security Verification Standard) is the industry standard for mobile app security.
Testcontainers is a Python library that providing a friendly API to run Docker container. It is designed to create runtime environment to use during your automatic tests.
Statistical package in Python based on Pandas
Autobahn WebSocket protocol testsuite
A modern open-source online judge and contest platform system.
Trustworthy AI related projects
Contest Management System
CodeAgent is an open-source coding agent that lives in your terminal. It understands your repository, plans multi-step changes, writes and edits files, runs commands and tests, and iterates until the task is done — all with a transparent, extensible tool loop.
Travel through time in your tests.
Free strategy scorecard for trading backtests. Detect overfitting, weak edge, drawdown risk, and random-timing luck from returns, equity curves, or trade logs.
Python toolkit, MCP server, and agent skills for reproducible, auditable clickstream and event log analytics. Helps AI agents, data scientists and analysts build, validate, and cross-check product analytics, quantitative UX, customer journeys, graph-based user flows, behavioral segmentation, A/B tests, process mining models, Markov chain simulation
Python library to handle Gene Ontology (GO) terms
:pancakes: The most popular pytest snapshot plugin
The successor to nose, based on unittest2
Home of test harnesses used in LTT Labs MarkBench
E2E test framework for tests with complex environment requirements.
Autotest - Fully automated tests on Linux
:game_die: Pytest plugin to randomly order tests and control random.seed
ArchUnitPython is an architecture testing library. Specify and ensure architecture rules in your Python app. Easy setup and pipeline integration.
Show coverage stats online via coveralls.io
Pytest plugin to write end-to-end browser tests with Playwright.
This dbt package captures metadata, artifacts, and test results so you can detect anomalies, monitor data quality, and build metadata tables. It powers Elementary OSS and feeds the wider context layer used by Elementary Cloud’s full Data & AI Control Plane.
An automated benchmark platform for AI-generated apps — built-in evaluation rules, standard sample sets, and layered test cases across a multi-dimensional metric system. One pipeline runs build, install, E2E tests, and scoring into a shareable report.
Coordinate Claude, Codex and Cursor windows with shared tasks, acknowledgements, prechecks, parallel tests, source-bound proofs and independent review. Built-in skills recall lessons, simplify code and forecast work. Track progress, decisions and evidence in a bilingual local dashboard, with MCP plugins. Browse skills and verified security audits.
Terminal-first, knowledge-grounded multi-agent software delivery pipeline: scope requirements, implement changes, run tests, and gate pull requests with deterministic QA and ensemble code review.
An agent-native QA CLI for web pages. Deterministic, no tests to write, no LLM.
Verify that your tests actually executed the source tree you think they did.
Reproducible monthly demand forecasting with Random Forest, chronological backtests, transparent baselines, and a guided local app.
Reconstructing DX-Ball 1.07 with REA, backed by original-x86 differential tests and pinned MSVC byte-exact oracles.
Find and repair substance defects in AI-assisted prose, code, docs, and agent output. Reports defects, never authorship. Structural tests over model judgement, because LLM judges agree with human slop labels at chance.
AI skill for typed, auditable workflow graphs, conditional routing, evidence-gated evolution, and validation. Includes full source, examples, and tests.
Human-in-the-loop planning preset for DeepSeek Harness (DSH), adapted from prime-plans: researched Markdown plans in ./dsh-plans, reviewer/criticizer subagent refinement, per-workspace language & model settings, goal-driven execution with ponytail + MVP tests.
500+ algorithmic-trading skills for AI coding agents in the agentskills.io format. Every skill ships a working Python reference implementation and its own tests - 20,291 in CI. Broker APIs, backtesting, risk, execution, ML, compliance and 10 more domains. Apache-2.0
Desktop app that automatically tests Windscribe servers, protocols and ports to find what works on your network. English, Farsi and Russian.
Scans Kalshi and Polymarket for arbitrage opportunities, runs the strategy as paper trading on live prices, and backtests it. Built with https://synpath.dev
Practice the AI-assisted coding interview format with your own coding agent: ten problems with planted bugs, stubs, timed tests, and an interviewer prompt