कंटेंट पर जाएँ
TakoAPI
स्किल्स पर वापस

visual-rpa-skill

neilhexiaoning-alt द्वारा

Web & Frontend Development
—अभी तक कोई रेटिंग नहीं
आपकी रेटिंग

संक्षिप्त

Visual RPA desktop automation skill.

विवरण

यह स्किल क्या करती है

Automates desktop interactions using screen capture and the Qwen vision model (Qwen-VL). It locates UI elements visually without needing DOM access or accessibility APIs, then executes mouse and keyboard actions with screenshot-based verification. Compound instructions are automatically broken into atomic steps.

Works on any desktop UI regardless of whether the app exposes accessibility APIs or a DOM, making it usable on locked-down or legacy applications.

इसे कब इस्तेमाल करें

  • Send a WeChat message without touching the keyboard
  • Open a browser and navigate to a specific URL
  • Create a new folder on the desktop via right-click menu
  • Type search queries into desktop app input fields
  • Automate multi-step app workflows with a single command

उदाहरण वर्कफ़्लो

इनपुट

User asks: open WeChat, find File Transfer Assistant, type hello, and send it

एजेंट
  1. 1

    Capture screen thumbnail to rough-locate the WeChat icon

  2. 2

    Crop full-resolution region around icon for precise coordinates

  3. 3

    Click WeChat icon and verify it opens via screenshot

  4. 4

    Navigate to File Transfer Assistant chat and click input box

  5. 5

    Type hello using clipboard paste and click the send button

आउटपुट

3/3 steps succeeded — message sent via WeChat File Transfer Assistant

आवश्यकताएँ

  • DASHSCOPE_API_KEY environment variable

इंस्टॉलेशन

clawhub install neilhexiaoning-alt/visual-rpa-skill

CLI कमांड चलाएँ, या प्रॉम्प्ट को Claude Code, Cursor, Codex या जो भी कोडिंग एजेंट आप इस्तेमाल करते हैं उसमें पेस्ट करें।

लिंक