कंटेंट पर जाएँ
TakoAPI
स्किल्स पर वापस

mac-use

kekejun द्वारा

Browser & Automation
2.1kclawskills.sh द्वारा बताए गए डाउनलोड
3स्टार
1व्यूज़
0 लाइकइस स्किल को लाइक करने के लिए साइन इन करें
—अभी तक कोई रेटिंग नहीं
आपकी रेटिंग

संक्षिप्त

Control macOS GUI apps visually — take screenshots, click, scroll, type.

विवरण

यह स्किल क्या करती है

Controls macOS GUI applications through a screenshot-then-interact loop. Takes annotated screenshots using Apple Vision OCR to detect and number text elements, then clicks, types, scrolls, or presses keys based on what's visible on screen. Works with any app that has a graphical interface.

Unlike AppleScript or accessibility APIs, this works on any app regardless of whether it exposes automation hooks, since it operates purely on what's visible on screen.

इसे कब इस्तेमाल करें

  • Automating repetitive clicks in desktop apps without scripting APIs
  • Filling out forms in apps that lack command-line access
  • Navigating WeChat mini-programs or other sandboxed GUI environments
  • Scraping data visible on screen from apps with no export option
  • Testing desktop app UI flows end-to-end

उदाहरण वर्कफ़्लो

इनपुट

User asks: open Safari, go to example.com, and click the first link

एजेंट
  1. 1

    Run open -a Safari and wait 2 seconds

  2. 2

    Run screenshot command on Safari, read annotated image at /tmp/mac_use.png and element list JSON

  3. 3

    Identify address bar element number from OCR output, click it with clicknum

  4. 4

    Type the URL and press return key, wait for page to load

  5. 5

    Screenshot again, identify first link by element number, click it with clicknum

आउटपुट

Safari navigates to example.com and opens the first link on the page

इंस्टॉलेशन

clawhub install kekejun/mac-use

CLI कमांड चलाएँ, या प्रॉम्प्ट को Claude Code, Cursor, Codex या जो भी कोडिंग एजेंट आप इस्तेमाल करते हैं उसमें पेस्ट करें।

लिंक