Google Researchers Use AI's Search History to Cut the Cost of Self-Improvement

Google researchers developed Dream-RSI, a framework that uses an AI agent's search history to improve future exploration while reducing the cost of automated discovery. The system tests alternative search strategies by replaying recorded outcomes, then deploys the strongest strategy without changing the underlying AI model. Across eight algorithm, mathematics and GPU programming tasks, Dream-RSI matched or improved on competing approaches while using fewer AI-agent calls in several tests.