Self-improving AI, also known as recursive self-improvement, refers to AI systems that iteratively enhance themselves. Mirendil's co-founders come from Anthropic, which is also researching this concept. Additionally, startups like Recursive Superintelligence and Ricursive Intelligence have been founded around this goal.
Mirendil believes this process will automate much of science and AI research, helping scientists make progress in fields like medicine, biology, and materials science. Neyshabur said that AI can mimic human scientists by learning new domains, accumulating knowledge, and gradually improving performance. Users only need to point out a problem, and the AI will continuously improve over time.
He gave an example: an AI system could continuously research Alzheimer's disease, improving its knowledge and performance, thus allowing AI to set ambitious goals and make sustained progress.