OpenAI stated that among over 700 manuscripts, only 300 core results have completed formal verification, about 42%, and said it will continue updating the repository as more formal proofs are obtained. As of the time of reporting, less than half of these manuscripts have completed formal verification.
Multiple mathematicians complained to The Verge about insufficient formal verification coverage, especially given the enormous number of results. They emphasized that even if a result comes with Lean code, evaluation does not mean it can be completed immediately—researchers still need to further check: does this formal proof actually prove the conclusion claimed in the paper, or does it only prove a related but not fully equivalent proposition?
Kevin Buzzard, a mathematics professor at Imperial College London, provided a concrete slice. In his field of algebraic number theory, he found many relevant theorems, but only about six results stood out at first glance, and almost none of these appeared to have been formally verified in Lean. His situation thus became: either read this potentially incorrect material, or wait for others to read it first, or wait for someone to formalize it before determining correctness.
Insufficient verification is not an abstract concern. Researcher Fan Nie said that when they used their self-built verification system OSVerify to check OpenAI's October 4 version of "Global quantum geometric Langlands at irrational level," they found two major issues, one of which the system also proposed a fix for. This suggests a new paradigm: AI generates proofs, and another AI system finds errors and patches them.