Performance
Latency numbers for the things agents actually do.
Real numbers, measured against the dev cluster on a wired 5 Gbps LAN. WAN adds ~30 ms of round-trip on top.
Sandbox open
| Platform | P50 | P95 | P99 |
|---|---|---|---|
| macOS (warm) | 385 ms | 3.4 s | 6.4 s |
| Simulator (cold boot) | ~45 s | ~70 s | ~80 s |
macOS sandboxes come out of a warm pool — P50 is the steady state. P95/P99 cover the case where the warm slot was just claimed and the pool is busy cloning the next VM. Apple simulator sandboxes aren't warm-pooled yet; first boot takes ~45 s.
Input — mouse & keyboard
Round-trip from client.method() to ACK from cua-server inside the macOS VM.
| Method | P50 | P95 | P99 |
|---|---|---|---|
mouse.click | 98 ms | 165 ms | 433 ms |
mouse.move | 93 ms | 163 ms | 545 ms |
mouse.get_position | 97 ms | 117 ms | 550 ms |
keyboard.type | 95 ms | 112 ms | 441 ms |
keyboard.press | 92 ms | 160 ms | 531 ms |
keyboard.hotkey | 96 ms | 116 ms | 446 ms |
display.get_windows | 239 ms | 409 ms | 720 ms |
Screenshot & composite ops
screenshot returns a PNG of the full display. act does click-then-screenshot in a single round-trip; agent_loop is the same shape an agent sees per step.
| Method | P50 | P95 | P99 |
|---|---|---|---|
screenshot | 1361 ms | 1780 ms | 2243 ms |
act (click + screen) | 1392 ms | 1730 ms | 1940 ms |
agent_loop (one step) | 1380 ms | 1785 ms | 1912 ms |
recording.start+stop | 1353 ms | 1789 ms | 2086 ms |
Screenshots dominate every composite op — if you can run with compressed JPEGs or partial regions, do.
Exec
Short macOS shell commands (ls, echo) round-trip in ~80 ms P50. Long commands stream output — no extra overhead until they finish.
Hardware
Each Mac mini is a stock M4 with 16 GB RAM and 512 GB SSD. The 2 macOS VMs share that with 4 cores + 8 GB each; simulator sandboxes run on the host alongside.
Concurrency
- Per Mac mini: 2 macOS sandboxes + 2 simulator sandboxes simultaneously.
- Per reservation: N × 2 macOS + N × 2 simulators (N = Macs you reserved).
- The fleet currently has 40 Mac minis live and growing; you can reserve up to all of them if available.