The post-training process is divided into four stages: two rounds of supervised fine-tuning (SFT), with emphasis on agent data; teacher specialization, training expert teachers for domains like math, code, and tool use; multi-domain policy distillation (MOPD), distilling expert teachers into a single student model; and agentic reinforcement learning (Agentic RL), conducting multi-round reinforcement learning in real agent frameworks.
The Agentic RL pipeline separates model optimization, inference, and environment execution, coordinating through a training engine, replay engine, and sandbox service. Black-box frameworks like OpenClaw or Hermes Agent can be integrated without modification, while capturing token-level trajectories for training sample reconstruction and validation.