macos-desktop-control
emptyopen 제작
Coding Agents & IDEs요약
A high-fidelity automation bridge for macOS (Darwin) that enables agents to perceive the desktop state and execute.
설명
이 스킬이 하는 일
Gives agents the ability to see and interact with a macOS desktop. Uses cliclick for mouse and keyboard input, and the native screencapture utility to capture the current screen state as a PNG.
Lets agents control any macOS app regardless of whether it exposes an API or CLI interface.
사용 시점
- Clicking UI buttons in apps that lack an API
- Typing into desktop application fields
- Automating repetitive GUI workflows on Mac
- Taking screenshots to verify visual state
- Moving the mouse to trigger hover-based UI elements
예시 워크플로
User asks: open the Settings app and take a screenshot of the Wi-Fi panel
- 1
Calls see to capture current screen state
- 2
Identifies the Settings icon position from the screenshot
- 3
Calls click with coordinates to open Settings
- 4
Navigates to Wi-Fi using click and type commands
- 5
Calls see again to capture the Wi-Fi panel
PNG screenshot saved to /tmp/claw_view.png showing the Wi-Fi settings panel
요구 사항
- cliclick installed via Homebrew (brew install cliclick)
- macOS screen recording permission granted to the terminal or agent process
설치
clawhub install emptyopen/macos-desktop-controlCLI 명령을 실행하거나, 프롬프트를 Claude Code, Cursor, Codex 등 사용하는 코딩 에이전트에 붙여넣으세요.