تخطَّ إلى المحتوى
TakoAPI
العودة إلى المهارات

visual-rpa-skill

بواسطة neilhexiaoning-alt

Web & Frontend Development
—لم يُقيَّم بعد
تقييمك

موجز

Visual RPA desktop automation skill.

الوصف

ما الذي تفعله هذه المهارة

Automates desktop interactions using screen capture and the Qwen vision model (Qwen-VL). It locates UI elements visually without needing DOM access or accessibility APIs, then executes mouse and keyboard actions with screenshot-based verification. Compound instructions are automatically broken into atomic steps.

Works on any desktop UI regardless of whether the app exposes accessibility APIs or a DOM, making it usable on locked-down or legacy applications.

متى تستخدمها

  • Send a WeChat message without touching the keyboard
  • Open a browser and navigate to a specific URL
  • Create a new folder on the desktop via right-click menu
  • Type search queries into desktop app input fields
  • Automate multi-step app workflows with a single command

مثال على سير العمل

الإدخال

User asks: open WeChat, find File Transfer Assistant, type hello, and send it

الوكيل
  1. 1

    Capture screen thumbnail to rough-locate the WeChat icon

  2. 2

    Crop full-resolution region around icon for precise coordinates

  3. 3

    Click WeChat icon and verify it opens via screenshot

  4. 4

    Navigate to File Transfer Assistant chat and click input box

  5. 5

    Type hello using clipboard paste and click the send button

الإخراج

3/3 steps succeeded — message sent via WeChat File Transfer Assistant

المتطلبات

  • DASHSCOPE_API_KEY environment variable

التثبيت

clawhub install neilhexiaoning-alt/visual-rpa-skill

شغّل أمر واجهة سطر الأوامر، أو الصق النص في Claude Code أو Cursor أو Codex أو أي وكيل برمجة تستخدمه.

الروابط