Google DeepMind announced Gemini Robotics ER 2, a new AI model designed to enhance robot reasoning, video understanding, task orchestration, and multi-robot collaboration. The model represents a significant advancement in enabling robots to solve real-world tasks through improved perception and coordination.
SynthePulse Insight · AI deep reading
Version 1 · 1 source
Google DeepMind releases Gemini Robotics ER 2, an 'advanced brain' for robots that leverages real-time video understanding, task orchestration, and multi-robot collaboration to enable more flexible interaction with the physical world.
The core breakthrough of Gemini Robotics ER 2 lies in its deep integration of video understanding with task orchestration. By continuously watching its own video stream, the model tracks task progress in real time, autonomously adjusts when errors occur, and precisely determines when to move to the next step. This 'temporal intelligence' solves a long-standing challenge in robotics: knowing when a task is complete.
Compared to the previous generation ER 1.6, ER 2 maintains a lead in tool orchestration, with evaluations covering three control modes: real VLA, simulated VLA, and human teleoperation. The model's design allows robots to 'think while acting,' simultaneously reasoning about the next step and executing the current action, avoiding the traditional 'stop-and-think' pauses.
ER 2 introduces multi-robot collaboration for the first time, enabling multiple robots to work together in a shared space to complete complex workflows that a single robot cannot accomplish independently. This marks a leap from independent task execution to swarm intelligence.
The model achieves flexible collaborative orchestration by declaring low-level control interfaces (such as VLA models or navigation APIs) as tools and streaming multimodal video, audio, or text. Developers can build multi-robot collaborative physical AI applications on this foundation.
Gemini Robotics ER 2 is available to developers via the Gemini API, Google AI Studio, and the Gemini Enterprise Agent Platform (private preview). The model integrates the Gemini Live API, using bidirectional streaming endpoints to optimize latency-sensitive tasks and enable smooth real-time interaction.
To accelerate application deployment, Google DeepMind provides configuration and prompt examples, and in collaboration with Boston Dynamics, demonstrated Spot retrieving objects via natural language commands. The relevant code is open-sourced on GitHub, allowing developers to reuse it directly.
All information in this article comes from the official Google DeepMind blog and is a first-party product launch announcement. All capability descriptions are self-reported by the company and have not been independently verified by third parties.
Gemini Robotics ER 2 provides robots with a more powerful 'brain' through video understanding, real-time task orchestration, and multi-robot collaboration, but actual performance still needs to be verified by developers through the public API.
Primary report
Primary source
Also covered by 3 sources