oumi-ai / oumi

Easily fine-tune (SFT/RL), evaluate, and deploy Qwen, Gemma, or any open agentic LLM/VLM!

brexhq / CrabTrap

An LLM-as-a-judge HTTP proxy to secure agents in production

MigoXLab / dingo

Dingo: A Comprehensive AI Data, Model and Application Quality Evaluation Tool

walidboulanouar / awesome-jev-use-cases

Awesome list of TypeSafe AI Jev use cases: 74 demos ranked by likes, 150+ GitHub repos, limits, cost and API examples. CC0

PyModel / jev-judge-mcp

Typed judgment tools for MCP agents. TypeSafe's Jev model as verify, screen, find, classify, rerank, decide, compare, extract, review, gate, and score: the model judges, policy decides auto, review, or escalate.

akivet / Mica

A 4B decision model: calibrated probabilities for yes/no, choice and score questions over long inputs.

sumleo / RLCDAlignBench

RLCDAlignBench: 44 alignment-failure detection benchmarks and code for 'Just Ask Jev' (RLCD zero-shot detector of AI alignment failures)

volt-l18 / llm-redteam-pipeline

An automated, multi-turn LLM red-teaming pipeline that pits an Attacker model against a Target model to evaluate safety boundaries, featuring LLM-as-a-Judge scoring and an interactive HTML vulnerability dashboard.