mrkeyoor.com_
Tue 18 Aug 06:22 UTC
Automationevaluationupdated 18 Aug 2026

cua

Cua is an open-source toolkit for giving software agents a computer they can see and control. It combines background desktop drivers, disposable sandboxes, benchmark tooling, and macOS virtualization so teams do not have to assemble separate systems for each operating system.

trackingstars / 7d
Verdict

Cua is one of the more coherent open-source attempts to cover the whole computer-use workflow, from controlling a live app to provisioning environments and recording evaluations. Use it if cross-platform desktop work is central and you are prepared to own virtualization, permissions, and security details. For browser-only jobs or a single stable platform, a narrower tool will usually be easier to operate.

Setup3/5Quick entry commands, but serious multi-OS setup has real prerequisites
Docs4/5Clear paths, examples, references, and candid platform caveats
Community4/521,455 stars and current activity, tempered by 659 open issues
Maturity3/5Broad working surface, but Linux and some macOS flows remain rough

Who it’s for

Teams building agents that must operate native desktop applications
Researchers evaluating computer-use agents across established or custom tasks
Developers who need disposable Linux, macOS, Windows, or Android environments
Apple Silicon users who want scriptable macOS virtual machines
Claude Code, Cursor, Codex, or custom-client users who need an MCP-accessible desktop driver

Who it’s NOT for

Simple browser-only automation, because Cua's cross-OS scope adds machinery you may not need
Teams expecting every platform path to be equally settled, because Linux driver support is still described as pre-release and Wayland has limits
Buyers seeking a small, stable library with a narrow API surface, because this repository contains several ambitious products
Anyone unwilling to review installer scripts, VM images, permissions, and default guest credentials before production use

Setup reality

The first command is easy: the sandbox SDK installs with pip, while Driver and Lume offer shell installers. A real deployment is more involved than those snippets suggest. Python must be 3.11 or newer, desktop control requires operating-system permissions, benchmark use involves cloning the repository and creating an image, and local multi-OS work means managing QEMU or Apple virtualization details. Wayland routes have explicit limits, and a macOS guest may still stop at Setup Assistant. Expect an approachable trial, followed by meaningful platform and security work before unattended production use.

What Cua is trying to solve

Computer-use agents need more than a model and a screenshot. They need a controllable machine, reliable input, repeatable images, a way to run tasks, and evidence that a change improved rather than broke behavior. Cua brings those pieces into one open-source repository. Its scope is unusually broad: Cua Drivers controls native applications, Cua Sandbox provisions machines and exposes interaction APIs, Cua Bench runs evaluations and exports trajectories, and Lume manages macOS and Linux virtual machines on Apple Silicon.

That combination is the main reason to care. A team building desktop agents can otherwise spend months joining unrelated automation, virtualization, and evaluation projects. Cua proposes one vocabulary across local and cloud environments, with support listed for Linux containers, Linux VMs, macOS, Windows, and Android. The MIT license also makes it practical to inspect, adapt, and embed.

The strongest parts

Cua Drivers has a compelling operational idea: an agent can click, type, and verify in the background without taking over the user's pointer or application focus. For anyone testing an agent on a workstation, that is much more useful than automation that makes the computer unusable during a run. The same CLI and MCP server are presented for macOS, Windows, and Linux, with integrations named for Claude Code, Cursor, Codex, OpenClaw, and custom clients.

The sandbox API is also pleasantly direct. The README shows an ephemeral image selected by operating system, then shell, screenshot, mouse, keyboard, and mobile gesture operations through the same object. That is a sensible boundary for agent code: the task logic should not need a fresh rewrite just because an experiment moves from a Linux container to Windows or Android. Local QEMU support covers every listed platform and accepts custom QCOW2 or ISO images, while the hosted service covers the standard images.

Cua Bench makes the project more than a control library. It names OSWorld, ScreenSpot, and Windows Arena, supports custom tasks, runs jobs in parallel, and can export trajectories for training. The included command sequence is concrete enough to show the intended loop: install the benchmark CLI, create a base image, choose a dataset and agent, then run several jobs. Teams can connect development and evaluation without inventing a second orchestration layer.

Lume is another substantial component rather than a token compatibility claim. It uses Apple's Virtualization.Framework for macOS and Linux guests on Apple Silicon, supports restore images, and offers unattended presets. The README is refreshingly specific about what those presets change: they create a user, enable SSH and autologin, and disable sleep and screen locking. That specificity helps reviewers understand both convenience and risk.

Setup and rough edges

The polished commands hide several layers of work. Installing the Python package may take moments, but useful desktop automation requires system permissions, appropriate images, networking, storage, and a plan for secrets inside guests. Benchmark setup requires a repository clone, an editable CLI install, and image creation. Local support across five operating-system targets sounds uniform at the API level, not necessarily at the operational level.

Platform caveats matter. Linux driver support is labeled pre-release. X11 is supported, while Wayland depends on compositor-specific routes and has explicit limits for raw background input. On macOS, the Tahoe installation path is end-to-end verified, but Sequoia can still stop at the Accessibility screen on first display boot. These are honest disclosures, yet they also show why an unattended fleet needs testing against the exact host, guest, and desktop stack in use.

Security deserves deliberate handling. The Lume presets default to the username and password lume, enable SSH, enable autologin, and weaken normal screen-lock behavior. Those choices are understandable for disposable automation guests, but they are unsafe defaults for machines exposed to an untrusted network or reused with sensitive state. Review the remote installer scripts, rotate credentials, isolate networks, constrain agent privileges, and destroy or scrub environments between jobs.

The repository's breadth creates another cost. Driver, sandbox, benchmark, cloud, and virtualization concerns evolve at different speeds. A change that helps one platform can expose a new mismatch elsewhere, and 659 open issues is a meaningful triage burden. The README offers several paths and dedicated references, but maintainers and adopters still have a large compatibility matrix to manage.

Activity and community health

The project has 21,455 GitHub stars, which signals substantial attention, though stars are not evidence of production reliability. More useful is the timing: the latest listed release, sandbox-v0.4.1, arrived on August 17, 2026, and the repository was pushed again on August 18. That is strong evidence of active development.

The 659 open issues cut both ways. They suggest many users are trying the project and reporting needs, but they also warn that support demand and unresolved edge cases are high. The supplied data does not say how quickly maintainers answer or close issues, so it would be unfair to claim either excellent responsiveness or neglect. Treat Cua as lively, fast-moving infrastructure rather than a finished appliance.

Where it belongs in a real stack

Cua fits below an agent's planning logic and above the VM or container runtime. Let the agent choose actions, use Cua's sandbox and driver interfaces to execute them, and use Cua Bench to replay defined tasks and retain trajectories. Put your own policy layer around that path for credentials, network access, approvals, timeouts, and cleanup. Observability and artifact storage should remain explicit parts of your stack rather than assumptions delegated to the desktop guest.

The best fit is a team whose roadmap genuinely spans native applications or several operating systems. In that case, a shared API plus built-in evaluation can offset the setup cost. If every task lives in a website, browser-focused automation is smaller and easier. If the goal is only screen understanding or only Windows benchmarking, a specialized project will be clearer. Cua earns a trial for ambitious computer-use work, but production adoption should begin with one platform, one image, and a tightly bounded task set before expanding to a fleet.

Alternatives

ProjectWhat it isPick it when
Browser UseAn open-source framework focused on agents that operate websites through a browser.Pick this instead when the work stays in the browser and cross-OS desktop control would be unnecessary overhead.
OmniParserA screen-parsing project that turns user-interface screenshots into structured elements for agents.Pick this instead when perception research is the core problem and you do not need Cua's full sandbox and fleet layer.
Windows Agent ArenaA benchmark and environment centered on evaluating agents in Windows tasks.Pick this instead when rigorous Windows-specific evaluation matters more than one control API spanning several operating systems.

What people are saying

  1. [velocity-scout] trycua/cua

Sources

  1. Cua GitHub repository
  2. Cua homepage and documentation