The core breakthrough of the GPT-Live series is full-duplex voice processing. Unlike the previous Advanced Voice Mode (AVM), which operated in discrete 'listen-think-speak' steps, GPT-Live can process input and output audio simultaneously, enabling fluid interaction akin to a real phone call. The system decides its next action—speaking, listening, waiting, interrupting, uttering feedback signals like 'mm-hmm' or 'right', or triggering tool calls—multiple times per second.
This architecture was announced by OpenAI on July 8, with two versions: GPT-Live-1 and GPT-Live-1 mini. Both support voice input and output and can display visual cards for weather, stocks, sports, maps, etc., in the ChatGPT app. The app also supports image and file uploads, but real-time video and screen sharing are not yet available; OpenAI says they are in development.