visual-rpa-skill
neilhexiaoning-alt द्वारा
Web & Frontend Developmentसंक्षिप्त
Visual RPA desktop automation skill.
विवरण
यह स्किल क्या करती है
Automates desktop interactions using screen capture and the Qwen vision model (Qwen-VL). It locates UI elements visually without needing DOM access or accessibility APIs, then executes mouse and keyboard actions with screenshot-based verification. Compound instructions are automatically broken into atomic steps.
Works on any desktop UI regardless of whether the app exposes accessibility APIs or a DOM, making it usable on locked-down or legacy applications.
इसे कब इस्तेमाल करें
- Send a WeChat message without touching the keyboard
- Open a browser and navigate to a specific URL
- Create a new folder on the desktop via right-click menu
- Type search queries into desktop app input fields
- Automate multi-step app workflows with a single command
उदाहरण वर्कफ़्लो
User asks: open WeChat, find File Transfer Assistant, type hello, and send it
- 1
Capture screen thumbnail to rough-locate the WeChat icon
- 2
Crop full-resolution region around icon for precise coordinates
- 3
Click WeChat icon and verify it opens via screenshot
- 4
Navigate to File Transfer Assistant chat and click input box
- 5
Type hello using clipboard paste and click the send button
3/3 steps succeeded — message sent via WeChat File Transfer Assistant
आवश्यकताएँ
- DASHSCOPE_API_KEY environment variable
इंस्टॉलेशन
clawhub install neilhexiaoning-alt/visual-rpa-skillCLI कमांड चलाएँ, या प्रॉम्प्ट को Claude Code, Cursor, Codex या जो भी कोडिंग एजेंट आप इस्तेमाल करते हैं उसमें पेस्ट करें।