Valen-Team / Valen
git clone https://github.com/Valen-Team/Valen.git
Train a Jev-like multimodal model by yourself. System One Model, now with vision.
—
stars, 24h
—
stars, 7 days
+878
stars, 30 days · #346
878
★ total
84
forks · 0 open issues
Star history starts 2026-10-20; the chart appears after the second daily snapshot.
LanguageJupyter Notebook
LicenseApache-2.0
Created2026-09-23 (27d ago)
Last push4d ago
Watchers5
OwnerOrganization
Links
README excerpt
A multimodal decision model inspired by Jev — text, images and video in; decision probabilities out. English · 简体中文 Intro · News · Demos · Models & datasets · Eval results · Quick start · Cookbook ## ✨ Introduction Valen (万澜) brings visual perception to System One decision-making. Inspired by Jev, it evaluates text, images and video against task instructions and returns probabilities over supplied candidates, giving software a structured decision interface. The repository includes the model implementation, data processing, SFT and experimental RLCD training, and inference and evaluation commands, with support for training on your own data. ## 📰 News - **2026-10-13**: Released ONNX and GGUF versions of Valen models, available on Hugging Face. - **2026-10-13**: Added API access to `valen-preview-0923`, `valen-0-8b`, `valen-2b` and `valen-4b`. See the API quick start notebook for usage examples. - **2026-10-07**: **Faster, more accurate, more versatile.** Released the latest multimodal System One model **Valen (0.8B, 2B and 4B)**, supporting text, images and video, and the **VisualDecisionBench** benchmark. - **2026-09-30**: **Training&Inference Support:** Added Flash Attention 2 support, enabled training across multiple nodes and GPUs, and improved GPU memory utilization during training. - **2026-09-23**: Open-sourced the **Valen** repository and released **Valen-preview-0923** with its corresponding **training data**. ## 🎬 Demos **Valen** image and video decision-making — click the preview to watch the full demo. **Game decision-making** — five successful Valen rollouts. Click any preview to watch the full video. Sokoban Plans a 13-step optimal solution. Frozen Lake 11-step optimal safe route. Maze Completes a 22-step long-horizon route. Lane Racer Changes lanes and clears the course in 10 steps. Parkour Runner Chains jumps, dashes, ducks and runs over 14 steps. ## 📥 Models and datasets | Model | Download | | --- | --- | | Valen 0.8B | 🤗 Valen-0.8B | | Valen 2B | 🤗 Valen-2B | | Valen 4B | 🤗 Valen-4B | | Valen-preview-0923 (earlier release) | 🤗 Hugging Face | VisualDecisionBench contains Image and Video subsets for visual decision evaluation. Earlier releases include General 100k for training, General 5k for evaluation, and Sokoban for game training and evaluation. ## 📊 Evaluation results — Valen **Visual decisions at 0.8B, 2B and 4B.** Valen uses Qwen3.5 + Mixer with shared-state inference, trained with SFT on millions of samples. The evaluation compares these checkpoints with published decision models on **VisualDecisionBench-Image, VisualDecisionBench-Video and public JevBench**. Earlier results remain in the archived README. ## 🚀 Quick start Learn by running the Cookbook notebooks: **API quick start** · **model download and local inference**. Both use real evaluation cases with input previews, executable cells and saved results. 简体中文:API 入门 · 下载与本地推理. Install the dependencies. Run `hf auth login` if the Hugging Face repositories r