As a pioneer in reinforcement learning and a 2018 Turing Award winner, Sutton's views carry significant weight in academia. In his speech, he cited his own research experience and industry trends, but did not provide specific experimental data or quantitative indicators. For example, the claim that 'high-quality data is approaching its limits' lacks direct evidence from public dataset sizes or model performance curves, relying more on empirical observation.
It should be noted that Sutton's research background may introduce positional bias: reinforcement learning is his core field, and emphasizing experience-driven approaches aligns with his academic interests. Additionally, current LLM research continues to explore ways to improve data efficiency (e.g., few-shot learning, data synthesis), which may partially alleviate the 'data wall' problem. Sutton's speech should be seen as a critical supplement to the mainstream paradigm, not a definitive conclusion.