Bỏ qua tới nội dung
TakoAPI
Quay lại kỹ năng

macos-desktop-control

bởi emptyopen

Coding Agents & IDEs
1.6kLượt tải do clawskills.sh công bố
1Sao
0Lượt xem
0 lượt thíchĐăng nhập để thích kỹ năng này
—Chưa có đánh giá
Đánh giá của bạn

Tóm tắt

A high-fidelity automation bridge for macOS (Darwin) that enables agents to perceive the desktop state and execute.

Mô tả

Kỹ năng này làm gì

Gives agents the ability to see and interact with a macOS desktop. Uses cliclick for mouse and keyboard input, and the native screencapture utility to capture the current screen state as a PNG.

Lets agents control any macOS app regardless of whether it exposes an API or CLI interface.

Khi nào nên dùng

  • Clicking UI buttons in apps that lack an API
  • Typing into desktop application fields
  • Automating repetitive GUI workflows on Mac
  • Taking screenshots to verify visual state
  • Moving the mouse to trigger hover-based UI elements

Quy trình ví dụ

ĐẦU VÀO

User asks: open the Settings app and take a screenshot of the Wi-Fi panel

AGENT
  1. 1

    Calls see to capture current screen state

  2. 2

    Identifies the Settings icon position from the screenshot

  3. 3

    Calls click with coordinates to open Settings

  4. 4

    Navigates to Wi-Fi using click and type commands

  5. 5

    Calls see again to capture the Wi-Fi panel

ĐẦU RA

PNG screenshot saved to /tmp/claw_view.png showing the Wi-Fi settings panel

Yêu cầu

  • cliclick installed via Homebrew (brew install cliclick)
  • macOS screen recording permission granted to the terminal or agent process

Cài đặt

clawhub install emptyopen/macos-desktop-control

Chạy lệnh CLI, hoặc dán prompt vào Claude Code, Cursor, Codex hay coding agent bạn đang dùng.

Liên kết