Aller au contenu
TakoAPI
Retour aux skills

visual-rpa-skill

par neilhexiaoning-alt

Web & Frontend Development
—Pas encore noté
Ta note

Résumé

Visual RPA desktop automation skill.

Description

Ce que fait ce skill

Automates desktop interactions using screen capture and the Qwen vision model (Qwen-VL). It locates UI elements visually without needing DOM access or accessibility APIs, then executes mouse and keyboard actions with screenshot-based verification. Compound instructions are automatically broken into atomic steps.

Works on any desktop UI regardless of whether the app exposes accessibility APIs or a DOM, making it usable on locked-down or legacy applications.

Quand l'utiliser

  • Send a WeChat message without touching the keyboard
  • Open a browser and navigate to a specific URL
  • Create a new folder on the desktop via right-click menu
  • Type search queries into desktop app input fields
  • Automate multi-step app workflows with a single command

Exemple de workflow

ENTRÉE

User asks: open WeChat, find File Transfer Assistant, type hello, and send it

AGENT
  1. 1

    Capture screen thumbnail to rough-locate the WeChat icon

  2. 2

    Crop full-resolution region around icon for precise coordinates

  3. 3

    Click WeChat icon and verify it opens via screenshot

  4. 4

    Navigate to File Transfer Assistant chat and click input box

  5. 5

    Type hello using clipboard paste and click the send button

SORTIE

3/3 steps succeeded — message sent via WeChat File Transfer Assistant

Prérequis

  • DASHSCOPE_API_KEY environment variable

Installation

clawhub install neilhexiaoning-alt/visual-rpa-skill

Exécute la commande CLI, ou colle l'instruction dans Claude Code, Cursor, Codex ou l'agent de code que tu utilises.

Liens