Back to feed
News Story
THE DECODERT2
1 sources

OpenAI's GPT-5.6 Sol autonomously post-trained the smaller Luna model with a "fairly underspecified prompt"

Original

OpenAI's GPT-5.6 Sol autonomously fine-tuned the smaller Luna model using a single underspecified prompt, scoring 16.2 points higher on an internal recursive self-improvement benchmark than GPT-5.5. This suggests progress toward an automated researcher.

SynthePulse Insight · AI deep reading

GPT-5.6 Sol Autonomously Fine-Tunes Luna: A Milestone and Limitation in AI Recursive Self-Improvement

Version 1 · 1 source

OpenAI's new flagship model, GPT-5.6 Sol, autonomously fine-tuned the smaller model Luna with minimal human intervention, significantly outperforming its predecessor on a recursive self-improvement benchmark. However, the actual scope of this breakthrough may be narrower than it appears.

  • GPT-5.6 Sol autonomously fine-tuned the Luna model using a fairly vague prompt, including selecting training configuration, GPU, and executing scripts.
  • On OpenAI's internal recursive self-improvement (RSI) benchmark, Sol scored 16.2 points higher than the previous generation GPT-5.5.
  • An OpenAI employee clarified that Sol did not start from scratch but adapted its own fine-tuning configuration; otherwise, it would have required two additional weeks of work by two researchers.
  • Sol doubled the daily token output per researcher and increased internal inference compute allocation by 100 times.
  • Anthropic emphasized that full recursive self-improvement has not yet been achieved, but it may arrive sooner than most institutions expect.

Autonomous Fine-Tuning: From Vague Instruction to Complete Workflow

OpenAI announced that its latest flagship model, GPT-5.6 Sol, can independently fine-tune the smaller model Luna. Researchers gave Sol a "fairly vague prompt" via the Codex platform, instructing the model to find suitable training configurations, select appropriate GPUs, launch training scripts, and validate runs. According to OpenAI researcher Kathy Shi, such work previously required an advanced research team, and "an automated researcher is now very close to reality."

However, the scope of this achievement was later clarified by OpenAI employee Jason Liu. He pointed out that Sol did not conceptualize the training scheme from scratch but rather adapted the configuration already used for its own fine-tuning. In other words, Sol's task was to adjust the existing setup for Luna and run the training job. Liu stated that even so, it saved at least two researchers two extra weeks of work, "and that's still a big deal."

Recursive Self-Improvement Benchmark: Sol's Leap

To measure the model's ability to improve itself, OpenAI built an internal evaluation suite based on real AI research tasks, including debugging research systems, optimizing kernels and training workflows, running ML experiments, and improving other models. GPT-5.6 Sol scored 16.2 points higher than GPT-5.5 on the aggregated Recursive Self-Improvement (RSI) index, outperforming Terra, Luna variants, and previous models.

Recursive self-improvement refers to an AI system's ability to enhance itself, with each improvement making it better at further improvements, creating a feedback loop. This concept has long been central to AI safety research, as full realization could lead to a sharp explosion in capabilities. Sol's achievement demonstrates quantifiable progress in self-optimization, but there is still a gap from complete, human-free recursive improvement.

Quantitative Leap in Research Efficiency

OpenAI reported that after using GPT-5.6 Sol, researchers' daily token output more than doubled compared to the peak during GPT-5.5 usage. Meanwhile, pull requests and experiment counts also increased, enabling the team to turn ideas into results faster. Over the past six months, internal inference compute allocation for coding grew by 100 times, and agent-based token usage increased by about 22 times. OpenAI acknowledges that these metrics do not directly measure research progress but reflect the rapid expansion of AI-assisted work scale.

These data suggest that Sol has been deeply integrated into the development workflow, from debugging to experiment execution to result interpretation. However, it is worth noting that these data come from OpenAI itself and may be selectively presented.

Industry Perspective and Uncertainty

OpenAI's competitor Anthropic stated in early June that full recursive self-improvement has not yet been achieved, but it may arrive sooner than most institutions expect. Anthropic noted that its model Claude can already handle incremental work between paradigm shifts, with humans only responsible for single-digit percentage directional decisions. This contrasts with Sol's achievement: Sol demonstrates autonomy on specific, limited tasks, while Anthropic emphasizes ongoing human guidance.

Key uncertainties remain: does Sol's autonomous fine-tuning represent a general capability? Its success heavily relies on existing configurations, and the task is narrow. Additionally, OpenAI has not disclosed detailed information about the RSI benchmark, making independent verification difficult. Whether Sol's performance gains come from model scale or data advantages rather than genuine recursive improvement remains to be determined.

Credibility boundary

This article is based on a single source, a report from THE DECODER, which cited OpenAI's demonstration and employee statements. Core facts come from OpenAI's official statements, but manual verification is limited. Anthropic's comments are provided as industry comparison.

Insight takeaway

GPT-5.6 Sol's autonomous fine-tuning of Luna marks a concrete step on the path to recursive self-improvement, but this achievement builds on existing configurations, not autonomous iteration from scratch. Nonetheless, the efficiency gains are significant, accelerating the pace of AI research. Full recursive self-improvement remains an unattained vision, but competition is pushing its boundaries.

Sources for this version

  1. OpenAI's GPT-5.6 Sol autonomously post-trained the smaller Luna model with a "fairly underspecified prompt"

    THE DECODER

Primary report

THE DECODERT2

Primary source