cxuan-ai-labs

AI Agent & Coding ·

Codex Big Update: From a writing tool to an assistant who can operate your computer

English translation of the Chinese original. This version is generated for international readers and may be refined over time.

Interactive reading view ↗

English | Chinese Original

English translation of the Chinese original. This version is generated for international readers and may be refined over time.

Date: 2026-04-18

Codex has received a major update. It's new.Computer useComputer Assistant is required to install the Computer use plugin locally in Mac (Windows is also expected to be available soon)

You can set up a Computer use on the Codex desktop.

image-20260418155533936

You can use the computer directly, Codex can view and operate the graphical user interface on MacOS.

It can be used for command line tools or tasks that are not structured enough to perform, such as checking desktop applications, using browsers, changing application settings, processing data sources in non-plug-in form, or repeating errors that occur only in graphical user interfaces.

Codex officially said so.

image-20260418100838365

If you want to install Mac on top, you need to open it.

  1. ** Screen recording** permissions to see the target application.
  2. Authorization of ancillary functions to enable Codex to click, enter and navigate.

But as long as you're install Computer Use, CodeX will guide you to the installation, very silky.

c4bd2859fd980a588df1eac79b73c05d

Computer use solves a long-term pain point: a little GUI-level shock for software that is not open to API. Formerly, angent stopped when it came to this kind of app, and now Codex works like a human being.

It's based on models that capture screenshots, understand interface content, and then return to the operational instructions to be executed - "Click the top right button," "Play XXX in the input box", "roll page". These operations are performed by harness, and the results are then intercepted and the rings are closed.

More than 90 plugins were added to the wave, bringing in tools such as Atlas sian Rovo, CircleCI, CodeRabbit, Gitlab Issues, Microsoft's family barrel, and Neuon under the Databricks flag.

So what can it do

I asked Codex himself to answer what it could do.

af3e279b8998f87d6dd19279b3dc2e9b

And then I showed it the lowest-risk test -- it showed it how the system worked.

image-20260418154335455

Show it. Let it send my daughter-in-law a message.

image-20260417204735178

Even a circle of friends is not a problem.

image-20260418154419351

Officially: When to use, when to use

OpenAI has an important reminder in its official document:

Because computer use can affect app and system state outside your project workspace, use it for scoped tasks and review permission prompts before continuing.

An official list of scenes suitable for the use of Computer use:

  • Test MacOS application, iOS emulator process or other desktop application
  • Interact with software without API
  • Re-emerge only in graphical interface bug
  • Change Application Settings
  • Processing data sources without plugins

Not suitable scenarios: involves high-risk operations such as payments, the deletion of large amounts of data, and sensitive operations that require login certification and cannot be manually identified.

I feel like it's the GUI version of Claw

OpenClaw, you all know -- let AI control your computer tools, mouse, keyboard, browser take over. The benefits are free open source, and the downside is trouble-laying, pure commanding and reticence.

And I feel that Codex's built-in Computer use is equivalent to a GUI version of Claw, and you don't know how everyone thinks, after all, OpenClaw's toughest father Peter has been put on board OpenAI, and I think this time that Computer use is the next time AI will be the prototype to take over your personal PC.

Codex is now the GUI version of this logic - interface, project isolation, Skills Extension, Automation. OpenClaw has almost everything it can, and there are more support and distribution channels for OpenAi.

Claude Code, Cursor, all these competitions are heading in the direction of Universal Age. OpenAI's strategy this time is clear: turning Codex from a programming assistant in the editor to a digital colleague who works across the application, over time, across the tool chain.

It's not a functional supercharge, it's a direct ** location migration.**

Source