ifixai-ai / iFixAi
Independent Auditing of AI Agents. Run by human or the agent itself, to answer the most crucial question in the AI Agent Economy. Is the agent doing what is supposed to do? With iFixAi you can have this answer in less than 120 seconds.
usestrix / strix
Open-source AI penetration testing tool to find and fix your app’s vulnerabilities.
NVIDIA / garak
the LLM vulnerability scanner
NVIDIA-NeMo / Guardrails
NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.
Tencent / AI-Infra-Guard
A full-stack AI Red Teaming platform securing AI ecosystems via Agent Scan, Skills Scan, MCP scan, AI Infra scan and LLM jailbreak evaluation.
Giskard-AI / giskard-oss
🐢 Open-Source Evaluation & Testing library for LLM Agents
uber / ADR
ADR secures enterprise AI agents through observability, security benchmarking, and threat detection. Deployed at Uber.
msoedov / agentic_security
Agentic LLM Vulnerability Scanner / AI red teaming kit 🧪
ASCIT31 / Dark-Moon
Open-source autonomous AI penetration testing. 50 specialist agents across web, API, cloud, Active Directory, Kubernetes, CI/CD and AI/LLM (OWASP LLM Top 10). Runs on a local LLM behind a Privacy Gateway. Integrates with GitHub, GitLab, Jenkins, VS Code, JetBrains, n8n, Grafana & Splunk.
Zyrexnn / Cybermes
Autonomous Offensive Security, Bug Bounty & Red Teaming Agent Framework powered by Hermes Agent, specialized reasoning skills, and multi-model LLM orchestration.
toby-bridges / api-relay-audit
Local security audit for AI API relays and LLM proxies: detects prompt injection, model substitution, tool-call rewriting, SSE anomalies, error leakage, and Web3 wallet risks.
AgentSafeLabs / safelabs-eval
Red-teaming and evaluation framework for AI agents, built around an OWASP-inspired ASI01–ASI10 taxonomy
graygnatconsole / mcp-audit-tool
🛡️ Security audit CLI for Model Context Protocol (MCP) servers — scan AI agent configs for tool poisoning, rug pulls, hardcoded secrets, command injection & supply-chain risks. Pure Python, SARIF + CI ready.
liu00222 / Open-Prompt-Injection
This repository provides a benchmark for prompt injection attacks and defenses in LLMs
securetron-gh / aifw
AI Agent Identity and Access Management and Inference Firewall
Tcotl / AgentCapture
新一代反制型蜜罐平台：通过反向代理在真实业务系统中无损植入蜜饵与虚拟路由，利用功能性伪装与反向提示词注入反控 AI 渗透 Agent，实现攻击捕获、画像溯源与上线反制。
Cygnux-Labs / Tracekit
Tamper-evident tracing, policy gates and cross-checks for AI agents: see what the agent did, and why.
whitecircle / rise
RISE: Red-teaming via Iterative Strategy Evolution (NeurIPS 2026)
Karansingh1999 / PIIFlow
Policy-aware static taint analysis for detecting sensitive-data flows into LLM APIs.
Yuxuan2003 / Awesome-GUI-Agent-Security
GUI / Computer-Use / Browser Agent 安全论文清单 —— 按攻防轴组织，每篇附中文简介
kulchankas / paranoid
Your app is guilty until proven secure: an agent skill whose /hack-me breaks into your own running app, proves each bug with a real request, patches it, and re-verifies. Claude Code · Codex · Cursor.
Tcotl / DVLAA
DVLAA (Damn Vulnerable LLM and Agent Application) is a local LLM and Agent security range for OWASP LLM Top 10 and Agent security training.
scs0209 / laya-guard
Free local guardrail for AI coding agents: every tool_call judged on-device (regex + Laya), allow/review/block
rudratoshs / buried-injections
🛡️ Regex catches 0%, Meta's Prompt Guard 2 catches 1% of 629 realistic AgentDojo injection attacks when they're buried in tool output. Reproducible benchmark.
weidutech / pi-recon
Lightweight AI red teaming harness for authorized agent / GenAI challenges (BCTF Agent Plus–style): schedule, bounded recon, validate, digest.
volt-l18 / llm-redteam-pipeline
An automated, multi-turn LLM red-teaming pipeline that pits an Attacker model against a Target model to evaluate safety boundaries, featuring LLM-as-a-Judge scoring and an interactive HTML vulnerability dashboard.
CTRLRun / ctrlrun
The execution safety layer for AI agents.
francordel / myrtia
Myrtia — agent-native red teaming for LLMs and AI agents: a deliberating council of attacker models (propose, cross-critique, Borda vote, chairman synthesis), 13 attack strategies, live turn-by-turn UI and ASR analytics. Open-source, built on IBM ARES.