Based on the demo, ChatGPT's 'computer use' feature likely relies on screen recognition and simulated click/keyboard input, similar to Anthropic's Claude Computer Use or Microsoft's Copilot Vision. This means ChatGPT can 'see' on-screen content, understand app interfaces, and perform actions like clicking and typing. The built-in browser may be based on Chromium or similar technology, enabling ChatGPT to access web pages, extract information, and fill out forms like a human.
However, publicly available information is limited. OpenAI has not disclosed the specific list of supported apps, whether the feature is available to all users, or if there are security restrictions (e.g., blocking access to banking or payment apps). Additionally, the demo did not show completion of multi-step complex tasks, such as cross-app workflows like 'organizing data in Excel and then sending a report via email.'