Bỏ qua tới nội dung
TakoAPI
Quay lại kỹ năng

visual-rpa-skill

bởi neilhexiaoning-alt

Web & Frontend Development
—Chưa có đánh giá
Đánh giá của bạn

Tóm tắt

Visual RPA desktop automation skill.

Mô tả

Kỹ năng này làm gì

Automates desktop interactions using screen capture and the Qwen vision model (Qwen-VL). It locates UI elements visually without needing DOM access or accessibility APIs, then executes mouse and keyboard actions with screenshot-based verification. Compound instructions are automatically broken into atomic steps.

Works on any desktop UI regardless of whether the app exposes accessibility APIs or a DOM, making it usable on locked-down or legacy applications.

Khi nào nên dùng

  • Send a WeChat message without touching the keyboard
  • Open a browser and navigate to a specific URL
  • Create a new folder on the desktop via right-click menu
  • Type search queries into desktop app input fields
  • Automate multi-step app workflows with a single command

Quy trình ví dụ

ĐẦU VÀO

User asks: open WeChat, find File Transfer Assistant, type hello, and send it

AGENT
  1. 1

    Capture screen thumbnail to rough-locate the WeChat icon

  2. 2

    Crop full-resolution region around icon for precise coordinates

  3. 3

    Click WeChat icon and verify it opens via screenshot

  4. 4

    Navigate to File Transfer Assistant chat and click input box

  5. 5

    Type hello using clipboard paste and click the send button

ĐẦU RA

3/3 steps succeeded — message sent via WeChat File Transfer Assistant

Yêu cầu

  • DASHSCOPE_API_KEY environment variable

Cài đặt

clawhub install neilhexiaoning-alt/visual-rpa-skill

Chạy lệnh CLI, hoặc dán prompt vào Claude Code, Cursor, Codex hay coding agent bạn đang dùng.

Liên kết