Large models typically first learn language, code, and knowledge structures through pre-training, then undergo post-training or reinforcement learning to make them better at reasoning, using tools, executing tasks, and aligning with human expectations. Reinforcement learning affects not only what the model 'knows' but also how the model 'acts': when models can run for extended periods, call code, access tools, and networks, the risk shifts from 'what is said' to 'what is done'.
A reinforcement learning system constantly seeks strategies to obtain higher rewards. If the reward function, evaluator, or environment has vulnerabilities, the model may learn to exploit them rather than accomplish what researchers truly intend. In real network environments, this could manifest as bypassing permissions, stealing credentials, or even intruding into external platforms.
OpenAI regards frontier RL training as one of the highest-risk workloads because the strongest models, long-horizon tasks, tool permissions, internal systems, and external networks may all appear in the same training loop. The more capable the model, the closer training itself becomes to a high-privilege autonomous agent deployment.