Тег: desktop-automation

From HKU's Data Intelligence Lab: plugins or skills for Claude Code, Codex and other agents generate agent-callable CLIs for apps like GIMP, Blender and LibreOffice, and the cli-hub package manager finds and installs ready-made community CLIs. Needs Python 3.10+.

Companion skill for the agent-browser CLI: has the agent load usage matching the installed version to navigate, fill forms, take screenshots and run exploratory tests, and can also drive Electron desktop apps. Install the agent-browser CLI first; from Vercel Labs.

Lets agents operate the Windows desktop directly: launch apps, switch windows, simulate keyboard and mouse, read UI elements and run PowerShell, without needing a vision model. Windows only.

macOS screenshot and UI automation CLI: capture the screen, read the accessibility tree for structured UI elements, then click, type, and switch windows and menus. Also runs as an MCP server for Claude Code and Codex. Needs macOS 15+ with Screen Recording and Accessibility permissions.

macOS screen capture, accessibility-tree inspection and native UI automation, served over MCP so agents can see the screen and click, type and operate menus. Requires macOS 15+ with Screen Recording and Accessibility permissions granted.

Lets agents drive a local Adobe After Effects: create compositions, add text, shape, solid and camera layers, and set keyframes and expressions, for batch intros, lower thirds and motion graphics. Needs After Effects 2022+ and Node.js; build from source and open the bridge panel in AE.

Drives local Premiere Pro projects with 280+ operations: import, sequences, timeline cuts, transitions, effects, color, captions, audio ducking, export. Needs Premiere Pro 2020+, Node.js 20+ and the MCP Bridge (CEP) panel open; anonymous telemetry is on by default and can be turned off.

Lets agents operate WPS Office Writer, Spreadsheets and Presentation on your computer through 200+ MCP tools covering formulas, pivot tables, charts, comments, slide styling and animation. Requires WPS; clone, build from source and install the WPS add-in. Runs on macOS, Windows and Linux.

Controls local WPS Writer, Spreadsheets and Presentation via MCP with 200+ tools (formulas, pivot tables, layout, slide polishing) plus companion skills. The plugin installs only the skills; build the MCP server and WPS add-in per the README. Needs WPS Office and Node.js 18+.

Cross-platform UI automation skills built on Midscene.js visual recognition: control browsers, desktops, Android, iOS and HarmonyOS devices in natural language, and set up Vitest + Midscene E2E tests. Bring your own vision model API key; maintained by the Midscene team.

Uses Photoshop's COM interface so agents can create, open and save documents, add text and solid color layers, read the layer structure and run JSX scripts, handy for batch social graphics through chat. Windows only; needs Photoshop, Python 3.10+ and uv.

Bentley's official MCP: lets agents drive a running STAAD.Pro structural analysis session to define load cases, set member properties in bulk, extract model data and read or write CSV/Excel. Needs Windows 11+, STAAD.Pro 2025 or later open, and uv. A structural engineer must review results.