Skip to content
TakoAPI
Back to skills

windows-ui-automation

by wwb-daniel

Web & Frontend Development
7.3kDownloads reported by clawskills.sh
6Stars
1Views
0 likesSign in to like this skill
—Not yet rated
Your rating

Brief

Automate Windows GUI interactions (mouse, keyboard, windows) using PowerShell.

Description

What This Skill Does

Automates Windows desktop interactions using PowerShell scripts for mouse movement, keyboard input, and window management. Works by calling provided scripts with parameters to simulate user actions on any visible desktop application.

Works with any Windows application regardless of whether it exposes an API or supports automation natively.

When to Use It

  • Filling out forms in legacy enterprise desktop software
  • Clicking through multi-step installer dialogs automatically
  • Repositioning and resizing app windows for consistent screen layouts
  • Typing text into applications that have no scripting interface
  • Taking screenshots of specific windows to verify UI state

Example Workflow

INPUT

User asks: Open Notepad, type 'Hello World', and take a screenshot

AGENT
  1. 1

    Run AppActivate to focus the Notepad window by title

  2. 2

    Execute mouse_control.ps1.txt to move cursor to the text area and click

  3. 3

    Execute keyboard_control.ps1.txt with -Text 'Hello World' to type the string

  4. 4

    Press Enter using keyboard_control.ps1.txt with -Key '{ENTER}'

  5. 5

    Capture a screenshot of the Notepad window to confirm the result

OUTPUT

Screenshot of Notepad showing 'Hello World' typed in the document

Installation

clawhub install wwb-daniel/windows-ui-automation

Run the CLI command, or paste the prompt into Claude Code, Cursor, Codex or whichever coding agent you use.

Links