📈 GH Trending Explorer 🎲 Surprise me

Search: safety · Language: Python · clear

ifixai-ai / iFixAi

Independent Auditing of AI Agents. Run by human or the agent itself, to answer the most crucial question in the AI Agent Economy. Is the agent doing what is supposed to do? With iFixAi you can have this answer in less than 120 seconds.

▲ 7.1k/7d ★ 31k Python 🔥 4d ago
Baimuking / AI-Jailbreak

全网最全的 AI 破甲合集:一个仓库破甲所有模型。收录 1733 个上游破甲项目,9 条可一键安装的破甲卡覆盖 GPT/Claude/Gemini/DeepSeek/GLM/Kimi/Grok/Qwen 与本地模型,内置 llms.txt 让 Claude Code/Codex/Cursor 自己装 有用的话可以点个收藏星星,会持续收录

▲ 61/7d ★ 61 Python 1d ago
open-compass / opencompass

OpenCompass is an LLM evaluation platform, supporting a wide range of models from OpenAI, Anthropic, Gemini, Qwen, GLM, DeepSeek, etc, across 100+ datasets covering knowledge, reasoning, coding, science, language, long-context, and safety.

★ 7.5k Python today
NVIDIA-NeMo / Guardrails

NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.

★ 7.3k Python today
Tencent / AI-Infra-Guard

A full-stack AI Red Teaming platform securing AI ecosystems via Agent Scan, Skills Scan, MCP scan, AI Infra scan and LLM jailbreak evaluation.

★ 6.9k Python today
microsoft / agent-governance-toolkit

AI Agent Governance Toolkit — Policy enforcement, zero-trust identity, execution sandboxing, and reliability engineering for autonomous AI agents. Covers 10/10 OWASP Agentic Top 10.

★ 6.4k Python today
dry-python / returns

Make your functions return something meaningful, typed, and safe!

★ 4.4k Python today
jherrodthomas / automotive-skills-suite

100+ installable Claude skills covering Engineering areas such as, ISO 26262 functional safety, ISO/SAE 21434 cybersecurity, ISO 21448 SOTIF, AIAG-VDA quality (APQP/PPAP/FMEA), Automotive SPICE, and continuous improvement tools — every builder paired with a confirmation reviewer.

★ 3.3k Python 4d ago
sunnypilot / sunnypilot

sunnypilot is an open source driver assistance system. sunnypilot offers the user a unique driving experience for over 350 supported car makes and models with modified behaviors of driving assist engagements. sunnypilot complies with the safety policy from comma.ai's openpilot as accurately as possible.

★ 2.2k Python today
wuyoscar / Internal-Safety-Collapse

[NeurIPS 2026] Safety failures in coding agents and frontier LLMs. Reproducible workspaces for studying when AI agents generate unsafe data during task completion.

★ 1.9k Python today
Continuum-AI-Corp / OrcaRouter-Lite

Self-hosted LLM router with a managed safety net. OpenAI-compatible. BYOK. Single-workspace. Streaming. For more advanced routing choose hosted OrcaRouter

★ 1.5k Python 12d ago
cvs-health / uqlm

[JMLR 2026] UQLM: A Python package for LLM hallucination detection using uncertainty quantification

★ 1.2k Python 7d ago
cebeuq / Synthid-Bypass

Ai safety research showing a working bypass to Google's synthid on Nano Banana Pro

★ 986 Python 1mo ago
AgentSafeLabs / safelabs-eval

Red-teaming and evaluation framework for AI agents, built around an OWASP-inspired ASI01–ASI10 taxonomy

★ 873 Python 1d ago
xinxuxin / keystone-bench

A clinical decision-evidence benchmark: pull the one fact an answer rests on, and see whether the assistant's action moves with the evidence. Built on HealthBench.

★ 842 Python 1d ago
superwesleyhys-ux / factcircuit

FactCircuit: an auditable claim-and-evidence verification loop with immutable provenance, staged checks, bounded retrieval, and reproducible evaluation.

★ 805 Python 11d ago
MORTEN-BUUR / nordef-matrix-open-control

NORDEF Matrix Open Control: model-independent AI safety belt with 0/1/2 decisions, Ed25519 root gate, replay protection, evidence chain, and incident-pattern eval bank

★ 760 Python 17d ago
caiovicentino / polymarket-mcp-server

🤖 AI-Powered MCP Server for Polymarket - Enable Claude to trade prediction markets with 45 tools, real-time monitoring, and enterprise-grade safety features

★ 715 Python 1mo ago
Privado-Inc / privado

Open Source Static Scanning tool to detect data flows in your code, find data security vulnerabilities & generate accurate Play Store Data Safety Report.

★ 664 Python 6d ago
HowieHwong / TrustLLM

[ICML 2024] TrustLLM: LLM trustworthiness evaluation across truthfulness, safety, fairness, robustness, privacy and ethics. Python/CLI toolkit for local models, compatible APIs and AI agent orchestration.

★ 632 Python 16d ago
aisa-group / PostTrainBench

Measuring how well CLI agents like Claude Code or Codex CLI can post-train base LLMs on a single H100 GPU in 10 hours

★ 600 Python 18d ago
DemonDamon / AgenticX

AgenticX is a unified, production-ready multi-agent platform — Python SDK + CLI (agx) + Studio server + Machi desktop app. Features Meta-Agent orchestration, 15+ LLM providers, MCP Hub, hierarchical memory, avatar & group chat, skill ecosystem, safety sandbox, and IM gateway (Feishu/WeChat).

★ 554 Python today
Cranot / roam-code

Local codebase intelligence CLI + MCP server for AI coding agents: SQLite code graph, 28 languages, 287 commands, 246 MCP tools, change-safety gates, audit evidence, zero API keys.

★ 516 Python today
Prysai / Prysai-LLM-Playbook

An evidence-led, eight-locale LLM playbook: a transferable core, the Codex flagship track, and adapters for ChatGPT, Claude Code, Gemini, DeepSeek, and Grok.

★ 435 Python 27d ago
FuRongJun-1999 / dsh-memory

白箱AGI架构探索:元认知(自我认知循环)、持续学习(知识飞轮)、世界模型(条件空间+语义时空图)、自我改进(自举纪律)、零LLM白箱管线与可审计信任护栏。

★ 430 Python today
Cygnux-Labs / Tracekit

Tamper-evident tracing, policy gates and cross-checks for AI agents: see what the agent did, and why.

★ 138 Python today
whitecircle / rise

RISE: Red-teaming via Iterative Strategy Evolution (NeurIPS 2026)

★ 134 Python 6d ago
dk2472780158-ctrl / piper-dual-arm-smolvla-towel-folding

SmolVLA (SmolVLM2-500M) vision-language-action on real dual AgileX Piper arms — continuous authority blending on a proven ACT safety base folds a real towel. One command runs the full 750-step skill (status=0). Full illustrated course included

★ 106 Python 29d ago
sun461941-hub / ai-project-copilot

🚀 Turn ideas and repositories into showcase-ready AI projects with agents, RAG, multimodal AI, local models, evals, safety checks, and polished demos.

★ 98 Python 5d ago
Aiyawoc / CodexSessionManager

Safety-first GUI and CLI for auditing, backing up, importing, cleaning, and trimming Codex conversations without editing internal storage.

★ 96 Python 1mo ago
Sega757 / meta-core

Deterministic telemetry & control plane for multi-agent AI systems. Atomic POSIX JSONL event bus, W3C/OpenTelemetry DAG reconstruction, and circular handoff guardrails.

★ 85 Python 22d ago
xyaz1313 / phoenix

不死鸟 Phoenix — Hermes Agent 插件:路由分档/风险防线/自愈/存档点提醒/审批策略自适应,官方钩子接入,不改 Hermes 核心代码

★ 58 Python 2mo ago
zhangcy122 / OpenJev

Self-evolving cognitive decision engine & TypeSafe Jev alternative. Deliberative decision flywheel ('explore first, crystallize later' System 2→1) with 100% option-order invariance. Typed probabilistic API (Choice, Noul, Score) for Open LLMs, Laya (ModernBERT), & commercial Jev with calibrated logprobs and adaptive safety guards.

★ 44 Python 21d ago
xiongqi123123 / MarginAD

Mind the Margin: Safety- and Physical-Aware Planning for End-to-End Autonomous Driving

★ 39 Python 7d ago
nayakbhupen / Spnda

Zero-cost epistemic uncertainty quantification & hallucination detection for LLMs (90,000x faster than Semantic Entropy)

★ 33 Python 1mo ago
Bestpart-Irene / secondsign-core

The gate between an AI agent and real money. Runtime authorization for financial AI agents: structured intent, deterministic policy, human approval, execute-once gateway, tamper-evident receipts. Open core, Apache-2.0.

★ 32 Python 4d ago
scs0209 / laya-guard

Free local guardrail for AI coding agents: every tool_call judged on-device (regex + Laya), allow/review/block

★ 31 Python 1d ago
WLM-boop / D-ILP

Time-Efficient Iterative Learning Planning for Safety-Critical Dynamic Obstacle Avoidance

★ 30 Python 1mo ago

Load more →