Skip to content
TakoAPI
Back to skills

handsfree-windows-control

by lijinlar

Web & Frontend Development
398Downloads reported by clawskills.sh
0Views
0 likesSign in to like this skill
—Not yet rated
Your rating

Brief

Guide skill for controlling native Windows apps (UIA) and web browsers (Playwright) via the handsfree-windows CLI.

Description

What This Skill Does

Controls native Windows desktop apps and web browsers from the command line using the handsfree-windows CLI. Handles UI automation via Windows UIA for desktop apps and Playwright for browsers. Supports recording and replaying YAML macros that mix desktop and browser steps.

Combining UIA desktop control and Playwright browser automation in a single CLI with a shared macro format removes the need to maintain two separate automation toolchains.

When to Use It

  • Automating multi-step data entry in a Windows desktop app
  • Running end-to-end browser tests without writing test framework code
  • Discovering UI controls in an unfamiliar Windows app before scripting it
  • Recording a mixed desktop-and-web workflow as a reusable YAML macro
  • Taking browser screenshots or snapshots for verification during automation

Example Workflow

INPUT

User asks: open the company intranet in the browser, click 'Submit Report', then confirm the desktop notification appeared in Outlook

AGENT
  1. 1

    Run hf browser-open --url https://intranet.example.com to open the URL in the managed browser profile

  2. 2

    Run hf browser-snapshot --fmt text to inspect the page and locate the Submit Report button

  3. 3

    Run hf browser-click --text "Submit Report" to click it

  4. 4

    Run hf start --app "Outlook" then hf tree --title-regex "Outlook" --depth 5 to discover notification controls

  5. 5

    Run hf inspect --json to confirm the notification element is present

OUTPUT

Browser action completed and Outlook notification element confirmed via UIA tree

Requirements

  • Python (to run setup.py and scripts)
  • Windows operating system

Installation

clawhub install lijinlar/handsfree-windows-control

Run the CLI command, or paste the prompt into Claude Code, Cursor, Codex or whichever coding agent you use.

Links