agent-desktop (Vercel Labs)

Computer use without screenshots — the accessibility tree is the smarter eye.

Open Source Coding & Development
Visit Website ↗ by Vercel Labs

What is agent-desktop (Vercel Labs)?

agent-desktop, from Vercel Labs, is an open-source computer-use CLI for AI agents: it reads a desktop app's accessibility tree (not screenshots) and hands the agent JSON snapshots with stable refs, so Claude Code, Codex or Cursor can click, type and scroll in macOS, Windows and Linux apps with dozens of shared commands.

It is Apache-2.0 licensed with no model inside — you bring your own agent. No product logo exists in the repository (only docs and badges), so the directory shows a letter tile until the project ships one.

Key features

  • Open-source computer-use CLI for AI agents
  • Reads a desktop app's accessibility tree, not screenshots
  • Hands the agent JSON snapshots with stable refs
  • Claude Code, Codex or Cursor can click, type and scroll in macOS, Windows and Linux apps
  • Dozens of shared commands included

Pros

  • Accessibility tree, not screenshots — stable, cheap, precise
  • Cross-platform: macOS, Windows and Linux
  • Dozens of shared commands out of the box

Cons

  • No product logo exists in the repo — the directory shows a letter tile until the project ships one
  • No model inside — you bring your own agent

agent-desktop (Vercel Labs) at a glance

PricingOpen Source
CategoryCoding & Development
CompanyVercel Labs
Best forDevelopers giving Claude Code, Codex or Cursor hands on desktop apps without screenshots
Official websitegithub.com
computer-useaccessibilitycliopen-sourceagents

How to choose the right Coding & Development tool

The right coding tool depends on where you write code and how much of your codebase it can understand. IDE integration is the first filter — a tool that lives in your editor, sees your project files and respects your stack will help far more than a general chatbot you paste snippets into. Look for accurate completions, clear explanations of suggested changes, and strong refactoring and debugging support for your main languages. Privacy deserves real attention: check whether your code is used for training, and whether a self-hosted or enterprise option exists for sensitive projects. Price against the hours it actually saves — most developers feel the difference within the first week of real use.

Compare all Coding & Development tools →

agent-desktop (Vercel Labs) FAQs

What is agent-desktop (Vercel Labs)?

agent-desktop, from Vercel Labs, is an open-source computer-use CLI for AI agents: it reads a desktop app's accessibility tree (not screenshots) and hands the agent JSON snapshots with stable refs, so Claude Code, Codex or Cursor can click, type and scroll in macOS, Windows and Linux apps with dozens of shared commands.

What are the main features of agent-desktop (Vercel Labs)?

agent-desktop (Vercel Labs) offers Open-source computer-use CLI for AI agents, Reads a desktop app's accessibility tree, not screenshots, Hands the agent JSON snapshots with stable refs, Claude Code, Codex or Cursor can click, type and scroll in macOS, Windows and Linux apps and Dozens of shared commands included.

How much does agent-desktop (Vercel Labs) cost?

agent-desktop (Vercel Labs) is open source, so the software itself is free to download, use and self-host. Your only costs are the infrastructure you run it on and any paid services you connect to it.

What are the pros and cons of agent-desktop (Vercel Labs)?

Strengths of agent-desktop (Vercel Labs) include Accessibility tree, not screenshots — stable, cheap, precise; Cross-platform: macOS, Windows and Linux; Dozens of shared commands out of the box. On the downside, No product logo exists in the repo — the directory shows a letter tile until the project ships one; No model inside — you bring your own agent.