ifixai-ai / iFixAi
Independent Auditing of AI Agents. Run by human or the agent itself, to answer the most crucial question in the AI Agent Economy. Is the agent doing what is supposed to do? With iFixAi you can have this answer in less than 120 seconds.
Baimuking / AI-Jailbreak
全网最全的 AI 破甲合集：一个仓库破甲所有模型。收录 1733 个上游破甲项目，9 条可一键安装的破甲卡覆盖 GPT/Claude/Gemini/DeepSeek/GLM/Kimi/Grok/Qwen 与本地模型，内置 llms.txt 让 Claude Code/Codex/Cursor 自己装 有用的话可以点个收藏星星，会持续收录
Tencent / AI-Infra-Guard
A full-stack AI Red Teaming platform securing AI ecosystems via Agent Scan, Skills Scan, MCP scan, AI Infra scan and LLM jailbreak evaluation.
microsoft / agent-governance-toolkit
AI Agent Governance Toolkit — Policy enforcement, zero-trust identity, execution sandboxing, and reliability engineering for autonomous AI agents. Covers 10/10 OWASP Agentic Top 10.
kenryu42 / cc-safety-net
A pre-execution guard for AI coding agents. It blocks destructive Git and file system commands, plus common attempts to access sensitive files, before a tool call runs. Supports Amp Code, Antigravity CLI, Claude Code, Codex, Cursor, DeepSeek Harness, Devin CLI, GitHub Copilot CLI, Grok Build, Hermes Agent, Kimi Code, OpenClaw, OpenCode, and Pi.
cvs-health / uqlm
[JMLR 2026] UQLM: A Python package for LLM hallucination detection using uncertainty quantification
Anil-matcha / awesome-gpt-6-astra
Evidence-backed use cases, prompts, integrations, evaluations, and safety notes for OpenAI GPT-6 Astra.
AgentSafeLabs / safelabs-eval
Red-teaming and evaluation framework for AI agents, built around an OWASP-inspired ASI01–ASI10 taxonomy
xinxuxin / keystone-bench
A clinical decision-evidence benchmark: pull the one fact an answer rests on, and see whether the assistant's action moves with the evidence. Built on HealthBench.
lobehub / awesome-rsi
A curated research map of Recursive Self-Improvement (RSI): models, agents, harnesses, embodied systems, automated AI R&D, benchmarks, and safety.
superwesleyhys-ux / factcircuit
FactCircuit: an auditable claim-and-evidence verification loop with immutable provenance, staged checks, bounded retrieval, and reproducible evaluation.
h5i-dev / h5i
Unified Rust framework for building, verifying, and testing web apps. Kernel-based architecture for Lean 4 verification and GPU acceleration. Built-in red-teaming tools for automated vulnerability detection.
chrisliu298 / awesome-llm-unlearning
A resource repository for machine unlearning in large language models
aisa-group / PostTrainBench
Measuring how well CLI agents like Claude Code or Codex CLI can post-train base LLMs on a single H100 GPU in 10 hours
Justin0504 / Aegis
Runtime policy enforcement for AI agents. Cryptographic audit trail, human-in-the-loop approvals, kill switch. Zero code changes.
xop01 / ai_goodpractice
full guide to help you integrate AI in your workflow, for both beginners and experienced users
cordum-io / cordum
The action firewall for AI agents. Enforce policy and human approval before risky tool calls, shell commands, workflows, and production changes, with auditable evidence.
strands-agents / box
Run AI agents in a sandbox that restricts what they can execute, read, write, and reach on the network. Box combines OS isolation with default-deny Dogwood policies and credential injection that keeps secrets outside the agent. Written in Rust. Supports macOS on Apple silicon, with Linux support planned.
Prysai / Prysai-LLM-Playbook
An evidence-led, eight-locale LLM playbook: a transferable core, the Codex flagship track, and adapters for ChatGPT, Claude Code, Gemini, DeepSeek, and Grok.
PerryLink / dsh-auto-review
Second-model AI auto-review for DeepSeek Harness approval requests: a read-only reviewer subagent returns structured allow/deny verdicts with reasons, fail-closed by default, fully auditable from the session log (approval/asked -> autoReview/verdict -> approval/decided).
Atomburstofficial / geiger
A Geiger counter for AI agents — one read-only command that inventories every agent, MCP server, plugin, and AI extension on a machine
canivel / dynolab
Dyno Lab — an AI safety, alignment and interpretability research workbench for Apple Silicon. Explore activations, probes, SAEs and interventions with local inference, a Python SDK, APIs and MCP.
Cygnux-Labs / Tracekit
Tamper-evident tracing, policy gates and cross-checks for AI agents: see what the agent did, and why.
whitecircle / rise
RISE: Red-teaming via Iterative Strategy Evolution (NeurIPS 2026)
PerryLink / dsh-permission-rules
Claude Code-style declarative permission rules for DeepSeek Harness: ordered allow/deny/ask rules with tool-name, argument (glob/regex), and workspace-path matching on the tools/pre-execute waterfall, session-log audit, and HMR reload.
Elite588 / Hacker
This repository is maintained by Hex Core and includes thousands of resources related to ethical hacking, bug bounties, digital forensics and incident response (DFIR), AI security, vulnerability research, exploit development, reverse engineering, and more. 🔥 Also check: https://hackertraining.org
mrtinkz / ai-charter
Universal AI Charter: plain-language governance principles and a public certification registry for AI models, built on disclosure instead of a development slowdown.
NingyuSUN / bioai-evidence-validator
Evidence validation and policy engine for AI-assisted biological curation
Sega757 / meta-core
Deterministic telemetry & control plane for multi-agent AI systems. Atomic POSIX JSONL event bus, W3C/OpenTelemetry DAG reconstruction, and circular handoff guardrails.
Sega757 / Chronos-V3-the-Architecture-of-Conjunctive-Transparency-C-T-
Bicameral deterministic AI runtime: Zero-hallucination System 1/2 reasoning engine with cryptographic audit trails (RFC 8785, Ed25519) and PoSP consensus arbitration.
mcpdelta / mcpdelta
Delta MCP is a free app that sits between your AI apps and their MCP servers: any server, every tool. It checks each task before it runs, applies it all or nothing, reads back what it changed and lets you undo it. Far fewer tokens on multi-step tasks, and shortcuts that run on a schedule. Coming soon for macOS, Windows and Linux.
buryusu / All-AI-Jailbreaks
Curated archive of jailbreak and prompt-injection experiments for AI model robustness research, red-teaming, and defensive evaluation.
WaseemGhanem98 / AgentCheck
Behavioral testing for AI agents.
officefloor / ImpactGate
Code review via the change impact measure
Math-for-AI-Safety / MAIS
Open problems, research agendas, and papers in Math for AI Safety — public from draft stage onward
AI-Safety-Institute / transect
Transcript analysis for long-horizon agent evaluations
xyaz1313 / phoenix
不死鸟 Phoenix — Hermes Agent 插件：路由分档/风险防线/自愈/存档点提醒/审批策略自适应，官方钩子接入，不改 Hermes 核心代码
e2sy / jailbreak-archives
A structured, versioned archive of adversarial prompt engineering techniques against Large Language Models — for AI safety research, red-teaming, and defensive hardening.
pinkbubblebubble / awesome-rsi
A curated, evidence-aware collection of recursive self-improvement research, agents, harnesses, benchmarks, and safety work.
ZhangRui987 / agent-oversight-framework
AI 执行与监察体系（Agent Oversight Framework）：分层治理规范 + L2 运行时监察参照实现——证据分级、自校正、边界诚实。A layered governance spec for AI agents, plus a runnable reference implementation of the L2 runtime-oversight layer. Docs CC BY-SA 4.0 / code Apache-2.0.
sylvesterkaczmarek / agent-boundary-check
Verify what AI coding agents can actually read, write, execute and reach using synthetic canaries.
Justinuse1 / pojia-breaker
Chinese-first LLM jailbreak benchmark & red-team toolkit | 中文LLM安全评测框架 | by POJIA.AI
SystemPromptIndex / SystemPromptIndex
1,017 system prompts from real AI products, audited span by span against the eight AISPA assurance dimensions
nayakbhupen / Spnda
Zero-cost epistemic uncertainty quantification & hallucination detection for LLMs (90,000x faster than Semantic Entropy)
Bestpart-Irene / secondsign-core
The gate between an AI agent and real money. Runtime authorization for financial AI agents: structured intent, deterministic policy, human approval, execute-once gateway, tamper-evident receipts. Open core, Apache-2.0.
TypeSafeAI / jev-harness
A custom coding harness for TypeSafe AI's Jev: an LLM proposes, Jev answers narrow questions, code decides, every step leaves a receipt.
scs0209 / laya-guard
Free local guardrail for AI coding agents: every tool_call judged on-device (regex + Laya), allow/review/block
gnt-ai / gnt
Checks every AI agent action against your company's real rules before it runs. Git-native, PR-reviewed.
AskTheWay / dsh-jev-interceptor
⚡ Millisecond System-1 judgement for every tool call in DeepSeek Harness — Jev-powered risk classification & evidence-gated auto-approval. Fail-closed by construction. dsh 生态第一个 System-1 决策插件
sumleo / RLCDAlignBench
RLCDAlignBench: 44 alignment-failure detection benchmarks and code for 'Just Ask Jev' (RLCD zero-shot detector of AI alignment failures)
CTRLRun / ctrlrun
The execution safety layer for AI agents.
francordel / myrtia
Myrtia — agent-native red teaming for LLMs and AI agents: a deliberating council of attacker models (propose, cross-critique, Borda vote, chairman synthesis), 13 attack strategies, live turn-by-turn UI and ASR analytics. Open-source, built on IBM ARES.