İçeriğe geç
TakoAPI
Becerilere dön

macos-desktop-control

emptyopen tarafından

Coding Agents & IDEs
1.6kİndirme sayıları clawskills.sh tarafından bildirilir
1Yıldızlar
0Görüntülenmeler
0 beğeniBu beceriyi beğenmek için giriş yapın
—Henüz değerlendirilmedi
Puanınız

Özet

A high-fidelity automation bridge for macOS (Darwin) that enables agents to perceive the desktop state and execute.

Açıklama

Bu Beceri Ne Yapar

Gives agents the ability to see and interact with a macOS desktop. Uses cliclick for mouse and keyboard input, and the native screencapture utility to capture the current screen state as a PNG.

Lets agents control any macOS app regardless of whether it exposes an API or CLI interface.

Ne Zaman Kullanılır

  • Clicking UI buttons in apps that lack an API
  • Typing into desktop application fields
  • Automating repetitive GUI workflows on Mac
  • Taking screenshots to verify visual state
  • Moving the mouse to trigger hover-based UI elements

Örnek İş Akışı

GİRİŞ

User asks: open the Settings app and take a screenshot of the Wi-Fi panel

AJAN
  1. 1

    Calls see to capture current screen state

  2. 2

    Identifies the Settings icon position from the screenshot

  3. 3

    Calls click with coordinates to open Settings

  4. 4

    Navigates to Wi-Fi using click and type commands

  5. 5

    Calls see again to capture the Wi-Fi panel

ÇIKIŞ

PNG screenshot saved to /tmp/claw_view.png showing the Wi-Fi settings panel

Gereksinimler

  • cliclick installed via Homebrew (brew install cliclick)
  • macOS screen recording permission granted to the terminal or agent process

Kurulum

clawhub install emptyopen/macos-desktop-control

CLI komutunu çalıştırın ya da istemi Claude Code, Cursor, Codex veya kullandığınız kodlama ajanına yapıştırın.

Bağlantılar