windows-ui-automation
oleh wwb-daniel
Web & Frontend DevelopmentRingkasan
Automate Windows GUI interactions (mouse, keyboard, windows) using PowerShell.
Deskripsi
Apa yang Dilakukan Skill Ini
Automates Windows desktop interactions using PowerShell scripts for mouse movement, keyboard input, and window management. Works by calling provided scripts with parameters to simulate user actions on any visible desktop application.
Works with any Windows application regardless of whether it exposes an API or supports automation natively.
Kapan Menggunakannya
- Filling out forms in legacy enterprise desktop software
- Clicking through multi-step installer dialogs automatically
- Repositioning and resizing app windows for consistent screen layouts
- Typing text into applications that have no scripting interface
- Taking screenshots of specific windows to verify UI state
Contoh Alur Kerja
User asks: Open Notepad, type 'Hello World', and take a screenshot
- 1
Run AppActivate to focus the Notepad window by title
- 2
Execute mouse_control.ps1.txt to move cursor to the text area and click
- 3
Execute keyboard_control.ps1.txt with -Text 'Hello World' to type the string
- 4
Press Enter using keyboard_control.ps1.txt with -Key '{ENTER}'
- 5
Capture a screenshot of the Notepad window to confirm the result
Screenshot of Notepad showing 'Hello World' typed in the document
Instalasi
clawhub install wwb-daniel/windows-ui-automationJalankan perintah CLI-nya, atau tempel prompt ke Claude Code, Cursor, Codex, atau coding agent apa pun yang Anda pakai.