Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 600+ LLMs (Qwen3.8, DeepSeek-V4, GLM-5.1, InternLM3, Llama4, ...) and 300+ MLLMs (Qwen3-VL, Qwen3-Omni, InternVL3.5, Ovis2.5, GLM5.3, Gemma4, Llava, Phi4, ...) (AAAI 2025).
Agent Reinforcement Trainer: train multi-step agents for real-world tasks using GRPO. Give your agents on-the-job training. Reinforcement learning for Qwen3.6, GPT-OSS, Llama, and more!
Easily fine-tune (SFT/RL), evaluate, and deploy Qwen, Gemma, or any open agentic LLM/VLM!
๐ An open-source, hands-on curriculum bridging the gap from basic RL concepts to LLM alignment, RLVR, and advanced Agentic systems.
Multimodal RL training framework for diffusion & omni models
The Continuous-Improvement Stack for Agents. Our environment data and evals power agent improvement and monitoring.
Halo is an open-source framework built by White Circle for training large language and multimodal models
An Asynchronous Reinforcement Learning Engine for Omni-Modal Post-Training at Scale
้ขๅ้ฟ็จ่ดญ็ฉ Agent ็ๅฏๅค็ฐๅ่ฎญ็ป
FineEnvs โ RL Environments 101: building and scaling RL environments in the age of LLMs
verl for a single consumer GPU. PPO, GRPO and on-policy distillation on NVIDIA GPUs.
Large language model systems implementation and optimization: Transformers, BPE tokenization, FlashAttention, Triton, distributed training, GPU profiling, and GRPO reasoning RL
โ
๐ AUGUstus: Autonomous Driving VLA Model with Unified Generation and Understanding. ๐๏ธ 512 H800 GPUs ยท ~2 days ยท 318K+ video hours ยท 513B+ training tokens. โก 12 Hz on-vehicle deployment. SFT + GRPO + NAVSIM.
P2T: Unlocking Token Rewards via Training-Free Reward Attribution (CVPR 2026) - official code
Unified reproductions, benchmarking & evaluation for perception-aware RLVR and OPD in VLMs. 19 methods ยท 30+ benchmarks ยท Official code of CGPO (ACM MM 2026 Oral).
A reinforcement learning environment for PCB autorouting, built on KiCad's push-and-shove router. Includes a decoder-only PPO/GRPO agent, LLM tool-calling and rule-based baselines, and a uniform 3-stage evaluation pipeline. The routing engine ships separately as the PCBWorld-Engine submodule (GPLv3).
Learning Native Reflection in Unified Models: reflection SFT and multi-round Flow-GRPO RL for BAGEL
Official implementation of AV-GRPO: dataset, training, and inference.
An explainable and reproducible post-training system for tool-using customer service agents with SFT, GRPO, verl and vLLM.
Official implementation of SOVA: Strict Outcome-Conditioned Virtual Advantages for Video Reasoning. Correctness-oriented calibration for TW-GRPO without extra rollouts.
Painting with RL , Teaching a Qwen3.5-35B model to pain with p5 js using GRPO