OpenAI Details GPT-Live Architecture for Continuous Stateful Voice Interaction

OpenAI published an engineering report on GPT-Live, describing an architecture that separates latency-sensitive media processing from broader application logic, with the real-time path handling only media pipelines and inference loops while other functions run behind an asynchronous RPC boundary. The system uses per-session dedicated stateful inference with context migration, and retains WebRTC while introducing WARP and Instant Connect to reduce startup latency. Justin Uberti, OpenAI's real-time AI lead, discussed the architecture and operational trade-offs in an interview with InfoQ.