Tencent / AI-Infra-Guard
A full-stack AI Red Teaming platform securing AI ecosystems via Agent Scan, Skills Scan, MCP scan, AI Infra scan and LLM jailbreak evaluation.
Tencent / AI-Infra-Guard
Baimuking / AI-Jailbreak
全网最全的 AI 破甲合集：一个仓库破甲所有模型。收录 1733 个上游破甲项目，9 条可一键安装的破甲卡覆盖 GPT/Claude/Gemini/DeepSeek/GLM/Kimi/Grok/Qwen 与本地模型，内置 llms.txt 让 Claude Code/Codex/Cursor 自己装 有用的话可以点个收藏星星，会持续收录
xinxuxin / keystone-bench
A clinical decision-evidence benchmark: pull the one fact an answer rests on, and see whether the assistant's action moves with the evidence. Built on HealthBench.
AgentSafeLabs / safelabs-eval
Red-teaming and evaluation framework for AI agents, built around an OWASP-inspired ASI01–ASI10 taxonomy
microsoft / agent-governance-toolkit
AI Agent Governance Toolkit — Policy enforcement, zero-trust identity, execution sandboxing, and reliability engineering for autonomous AI agents. Covers 10/10 OWASP Agentic Top 10.
Cygnux-Labs / Tracekit
Tamper-evident tracing, policy gates and cross-checks for AI agents: see what the agent did, and why.
sahibzada-allahyar / Formal-Verification-RSI
Formal verification for AI: a Lean 4 + Dafny proof checker that catches fake AI proofs (reward hacking), and verified recursive self-improvement (RSI) for coding agents. AI for math, physics and software engineering.
aisa-group / PostTrainBench
Measuring how well CLI agents like Claude Code or Codex CLI can post-train base LLMs on a single H100 GPU in 10 hours
whitecircle / rise
RISE: Red-teaming via Iterative Strategy Evolution (NeurIPS 2026)
AI-Safety-Institute / transect
Transcript analysis for long-horizon agent evaluations
scs0209 / laya-guard
Free local guardrail for AI coding agents: every tool_call judged on-device (regex + Laya), allow/review/block
sumleo / RLCDAlignBench
RLCDAlignBench: 44 alignment-failure detection benchmarks and code for 'Just Ask Jev' (RLCD zero-shot detector of AI alignment failures)
francordel / myrtia
Myrtia — agent-native red teaming for LLMs and AI agents: a deliberating council of attacker models (propose, cross-critique, Borda vote, chairman synthesis), 13 attack strategies, live turn-by-turn UI and ASR analytics. Open-source, built on IBM ARES.
cvs-health / uqlm
[JMLR 2026] UQLM: A Python package for LLM hallucination detection using uncertainty quantification
Prysai / Prysai-LLM-Playbook
An evidence-led, eight-locale LLM playbook: a transferable core, the Codex flagship track, and adapters for ChatGPT, Claude Code, Gemini, DeepSeek, and Grok.
canivel / dynolab
Dyno Lab — an AI safety, alignment and interpretability research workbench for Apple Silicon. Explore activations, probes, SAEs and interventions with local inference, a Python SDK, APIs and MCP.
Sega757 / meta-core
Deterministic telemetry & control plane for multi-agent AI systems. Atomic POSIX JSONL event bus, W3C/OpenTelemetry DAG reconstruction, and circular handoff guardrails.
Sega757 / Chronos-V3-the-Architecture-of-Conjunctive-Transparency-C-T-
Bicameral deterministic AI runtime: Zero-hallucination System 1/2 reasoning engine with cryptographic audit trails (RFC 8785, Ed25519) and PoSP consensus arbitration.
officefloor / ImpactGate
Code review via the change impact measure
xyaz1313 / phoenix
不死鸟 Phoenix — Hermes Agent 插件：路由分档/风险防线/自愈/存档点提醒/审批策略自适应，官方钩子接入，不改 Hermes 核心代码
sylvesterkaczmarek / agent-boundary-check
Verify what AI coding agents can actually read, write, execute and reach using synthetic canaries.
nayakbhupen / Spnda
Zero-cost epistemic uncertainty quantification & hallucination detection for LLMs (90,000x faster than Semantic Entropy)
Bestpart-Irene / secondsign-core
The gate between an AI agent and real money. Runtime authorization for financial AI agents: structured intent, deterministic policy, human approval, execute-once gateway, tamper-evident receipts. Open core, Apache-2.0.
CTRLRun / ctrlrun
The execution safety layer for AI agents.
WaseemGhanem98 / AgentCheck
Behavioral testing for AI agents.
NingyuSUN / bioai-evidence-validator
Evidence validation and policy engine for AI-assisted biological curation
superwesleyhys-ux / factcircuit
FactCircuit: an auditable claim-and-evidence verification loop with immutable provenance, staged checks, bounded retrieval, and reproducible evaluation.
tmchow / hermes-kids-profile-blueprint
Parent-operated starter kit for designing a private, child-facing Hermes Agent profile