feat(desktop): Computer Use for macOS, Windows, and Linux - #6537

Open

sheehanmunim wants to merge 90 commits into

pingdotgg:mainfrom

sheehanmunim:mac/computer-use

Commits on Aug 16, 2026

feat(codex): surface Computer Use and MCP tool approvals; Windows native bridge

authored and
sheehanmunim
committed
8ac5e65
fix(desktop): declare NSAppleEventsUsageDescription so Computer Use can drive apps

sheehanmunim
and
claude
committed
69846bf
Add macOS desktop control and agent-owned browser tabs

sheehanmunim
and
claude
committed
96340cd
Avoid a needless spread when listing agent tabs

sheehanmunim
and
claude
committed
07d36fb
test(desktop): cover the Apple Events usage description in build config

sheehanmunim
and
claude
committed
0fb502d
refactor(codex): drop the Windows Computer Use transport bridge

sheehanmunim
and
claude
committed
c91b49e
feat(desktop): add the Windows desktop-control MCP server

sheehanmunim
and
claude
committed
b5cee73
feat(desktop): add the Linux desktop-control backend

sheehanmunim
and
claude
committed
0edf91a
feat(desktop): ship the desktop-control server on Windows and Linux

sheehanmunim
and
claude
committed
3a1a52d
fix(desktop): write text through AT-SPI on Linux instead of synthetic keys

sheehanmunim
and
claude
committed
6ddc9b8
feat(desktop): bring agent-owned Chrome tabs to Windows and Linux

sheehanmunim
and
claude
committed
96ed810
fix(repo): stop the pre-commit formatter failing on native-only changes

sheehanmunim
and
claude
committed
345390d
fix(desktop): prefer X11 for capture when both display servers are present

sheehanmunim
and
claude
committed
9bd7d6b
fix(desktop): capture on Wayland through wlr-screencopy when xcap cannot

sheehanmunim
and
claude
committed
8564ef9
fix(desktop): commit the desktop server lockfile

sheehanmunim
and
claude
committed
9928d9c
refactor(desktop): name the desktop server executable in one place

sheehanmunim
and
claude
committed
7f6e512
fix(desktop): report the requested url when a new tab has not loaded

sheehanmunim
and
claude
committed
5e67704
fix(desktop): confirm browser actions in the macOS server's words

sheehanmunim
and
claude
committed
2a0ce40
feat(desktop): give the agent its own pointer, and stop taking the user's

sheehanmunim
and
claude
committed
13bbdfa
feat(desktop): Computer Use settings, pointer polish, Windows background clicks

sheehanmunim
and
cursoragent
committed
a2ad55a
feat(desktop): polish Computer Use settings and fix Windows Gdi import

sheehanmunim
and
cursoragent
committed
d9931d0
fix(desktop): satisfy Effect diagnostics in Computer Use permissions

sheehanmunim
and
cursoragent
committed
bf31335
fix(desktop): inject t3-desktop MCP for Cursor/Grok without HTTP session

sheehanmunim
and
cursoragent
committed
a71267c
fix(desktop): address Computer Use review findings

sheehanmunim
and
cursoragent
committed
6a2a6bd
fix(desktop): resolve Computer Use settings without widening session R

sheehanmunim
and
cursoragent
committed
7d3efc1
fix(desktop): skip bad MCP binary candidates and avoid overlay SIGPIPE

sheehanmunim
and
cursoragent
committed
7a8bafd
fix(desktop): make ServerSettings acquisition unmistakable for Macroscope

sheehanmunim
and
cursoragent
committed
d3ada85
fix(desktop): finish Computer Use correctness follow-ups

sheehanmunim
and
cursoragent
committed
0f06464
fix(desktop): harden background input fallbacks and group creation

sheehanmunim
and
cursoragent
committed
3fcd438
fix(desktop): close remaining Computer Use correctness gaps

sheehanmunim
and
cursoragent
committed
c7c6370
fix(desktop): inject t3-desktop MCP into Codex sessions

sheehanmunim
and
cursoragent
committed
5a9df75
fix(desktop): avoid JSON.stringify in Codex MCP -c overrides

sheehanmunim
and
cursoragent
committed
e58f0e7
fix(desktop): Windows agent cursor and Chrome extension reconnect

sheehanmunim
and
cursoragent
committed
2b374c4
fix(desktop): address Computer Use bot review findings

sheehanmunim
and
cursoragent
committed
ea2e1c3
fix(desktop): unique MCP elicitation correlation and session teardown

sheehanmunim
and
cursoragent
committed
1d4c73d
fix(desktop): serialize Chrome session cleanup and clear Effect path

sheehanmunim
and
cursoragent
committed
97dab49
fix(chrome-extension): keep agent group id across reconnect cleanup

sheehanmunim
and
cursoragent
committed
894906e
fix(desktop-mcp): raise Linux apps via EWMH when AT-SPI focus fails

sheehanmunim
and
cursoragent
committed
cb8a4d7
fix(desktop-mcp): harden Linux activate/type/press_key and Windows chmod

sheehanmunim
and
cursoragent
committed
3244b65
fix(desktop-mcp): use short bridge socket path when App Support is too deep

sheehanmunim
and
cursoragent
committed
2babdd7
fix(desktop-mcp): harden agent window ownership and Linux input cleanup

sheehanmunim
and
cursoragent
committed
0e9955a
fix(desktop-mcp): address follow-up Computer Use bot findings

sheehanmunim
and
cursoragent
committed
98f9f8e
fix(desktop-mcp): process follow-up Computer Use bot findings

sheehanmunim
and
cursoragent
committed
4587f66
fix(desktop-mcp): clear remaining Linux Computer Use bot findings

sheehanmunim
and
cursoragent
committed
32e7ea3
fix(desktop-mcp): drop accidental history.rs from Computer Use branch

sheehanmunim
and
cursoragent
committed
bc0b619
fix(desktop-mcp): keep AT-SPI insert on caret errors; harden Wayland coords

sheehanmunim
and
cursoragent
committed
b9bfe2f
fix(desktop-mcp): append on caret miss; drop Effect shim; Wayland scroll

sheehanmunim
and
cursoragent
committed
b1fd0c1
fix(desktop-mcp): error when Shift is required but unavailable

sheehanmunim
and
cursoragent
committed
5beb81c
fix(desktop-mcp): reject out-of-range pointer coords; lazy Shift_R lookup

sheehanmunim
and
cursoragent
committed
d8efd92
fix(desktop-mcp): sync Computer Use with Macroscope MCP hardening

sheehanmunim
and
cursoragent
committed
2e2c0e7
fix(desktop): repair ipc doc comment; drop unused Codex stateDir

sheehanmunim
and
cursoragent
committed
d9015ee
fix(settings): decorative brand icons and Computer Use bridge fallback

sheehanmunim
and
cursoragent
committed
5463d69
fix(desktop): port pointer animation and Win/Linux Computer Use parity

sheehanmunim
and
cursoragent
committed
22f058e
fix(desktop): repair desktop-mcp stage JSDoc opener

sheehanmunim
and
cursoragent
committed
872e4e9
fix(desktop): clear Macroscope Computer Use correctness findings

sheehanmunim
and
cursoragent
committed
5bb0416
fix(desktop): restore CaptureBox for window PNG race safety

sheehanmunim
and
cursoragent
committed
d37f87d
fix(desktop): clear follow-up Macroscope and Bugbot findings

sheehanmunim
and
cursoragent
committed
4f09070
fix(desktop): prefer under-point click targets and cap click_count

sheehanmunim
and
cursoragent
committed
6aa103e
fix(desktop): scope browser disconnects and tighten click/app resolution

sheehanmunim
and
cursoragent
committed
0b47c9a
fix(desktop): constrain click targeting and lock disconnect generation

sheehanmunim
and
cursoragent
committed
fe5b700
fix(desktop): report real tab ids and clearer off-screen click errors

sheehanmunim
and
cursoragent
committed
e7249ca
fix(desktop): ignore agent-cursor overlay in under-point hit tests

sheehanmunim
and
cursoragent
committed
3c1d79a
fix(desktop): resolve explicit app for drag/click without stale pid

sheehanmunim
and
cursoragent
committed
8d5f292
fix(desktop): allow background drags under occluding windows

sheehanmunim
and
cursoragent
committed
d4da8a1
fix(settings): use shared CollapsibleContent for More browsers

sheehanmunim
and
cursoragent
committed
144db52
fix(web): use CollapsiblePanel for More browsers disclosure

sheehanmunim
and
cursoragent
committed
4e6c7b4
fix(settings): extract More browsers collapsible into shared component

sheehanmunim
and
cursoragent
committed
a3338e5
fix(native): harden shared Computer Use bridge, capture, and app listing

sheehanmunim
and
cursoragent
committed
ce3f53a
fix(settings): share SettingRowTitle across Computer Use settings

sheehanmunim
and
cursoragent
committed
34a70a2
fix(native): hold agent-window lock through creation

sheehanmunim
and
cursoragent
committed
2248211
fix(native): drop computer-history entry from computer-use main

sheehanmunim
and
cursoragent
committed
d46a160
fix(cu): align bridge socket cleanup, display listing, and privacy settings error handling

sheehanmunim
and
cursoragent
committed
a18f529
fix(desktop): port shared Computer Use correctness fixes from history branch

sheehanmunim
and
cursoragent
committed
f10b773
fix(desktop): reject empty app query in macOS resolveApp

sheehanmunim
and
cursoragent
committed
9abb20a
fix(desktop-mcp): resolve numeric app names when PID is absent

sheehanmunim
and
cursoragent
committed
af7c7e5
fix(desktop-mcp): keep agent windows across AX gaps; exact numeric names

sheehanmunim
and
cursoragent
committed
21085c3
fix(desktop-mcp): remove History CLI; exact-match numeric app names

sheehanmunim
and
cursoragent
committed
22f85b6
fix(desktop-mcp): remove stray brace after native-host entry

sheehanmunim
and
cursoragent
committed
409bd09
fix(desktop-mcp): port shared Macroscope CU hardening from History

sheehanmunim
and
cursoragent
committed
6dabb18
fix(desktop-mcp): use MSG_DONTWAIT bridge writes; fix Shift and FRONTMOST

sheehanmunim
and
cursoragent
committed
8278c4e
fix(desktop-mcp): invoke press/click AT-SPI actions by name

sheehanmunim
and
cursoragent
committed
ed24147
fix(chrome-extension): use prod toolbar icon and unclip pointer favicon

sheehanmunim
and
cursoragent
committed
1343aa0
fix(desktop-mcp): harden Computer Use paths flagged on History rebase

sheehanmunim
and
cursoragent
committed
95d3a38
fix(web): clean agent cursor settings icon

sheehanmunim
and
cursoragent
committed
179ddbd
fix(web): use real agent-cursor overlay art in settings

sheehanmunim
and
cursoragent
committed
27530f6
fix(desktop): Effect 4 Context refs and softer agent-cursor icons

sheehanmunim
and
cursoragent
committed
dcdbd03
fix(web): soft-extend agent-cursor badge glow into purple frame

sheehanmunim
and
cursoragent
committed
0616bb1
fix(desktop-mcp): harden cross-window drag and bridge socket path

sheehanmunim
and
cursoragent
committed
03b1beb
fix(desktop-mcp): harden browser bridge and Linux/Windows input paths

sheehanmunim
and
cursoragent
committed
92d6674
fix(desktop-mcp): keep ambiguous activate_app matches fail-closed

sheehanmunim
and
cursoragent
committed
c918e12