Illustration, AI-generated from the story text. Tap a panel to read the story through it.

1 / 4Vercel releases agent-desktop, which lets coding agents drive native apps without screenshots×

The release

Vercel Labs released agent-desktop on Saturday under the Apache 2.0 license, a command-line tool that gives coding agents control of macOS, Windows and Linux applications. Chris Tate, who also built Vercel's agent-browser, called it "agent-browser, for your whole computer."

How it works

Most computer-use agents look at screenshots and guess where to click; this one reads the operating system's accessibility tree, the structured description of every button and field that screen readers use, and hands the agent JSON with a reference for each element.

In the background

Actions run in the background by default, so the user's own pointer does not move, and parallel subagents get their own colored cursors. It is written in Rust, contains no model, and works with any agent that can run a shell command.

The limits

Apps that expose no accessibility tree are out of reach. The repository passed 5,000 stars, and no independent comparison with screenshot-based tools has been published.

Sources and the full story

‹›

Vercel releases agent-desktop, which lets coding agents drive native apps without screenshots

Vercel Labs released agent-desktop on Saturday under the Apache 2.0 license, a command-line tool that gives coding agents control of macOS, Windows and Linux applications. Chris Tate, who also built Vercel's agent-browser, called it "agent-browser, for your whole computer." Most computer-use agents look at screenshots and guess where to click; this one reads the operating system's accessibility tree, the structured description of every button and field that screen readers use, and hands the agent JSON with a reference for each element. Actions run in the background by default, so the user's own pointer does not move, and parallel subagents get their own colored cursors.

It is written in Rust, contains no model, and works with any agent that can run a shell command. Apps that expose no accessibility tree are out of reach. The repository passed 5,000 stars, and no independent comparison with screenshot-based tools has been published. SourcesAC

Sources

• Aagent-desktop (GitHub, Vercel Labs)github.com
• CVercel agent-desktop (ShiftDelete)shiftdelete.net

This story ran in the Afternoon Brief of November 1st 2026.