本文へスキップ
TakoAPI
スキル一覧に戻る

handsfree-windows-control

lijinlar 作

Web & Frontend Development
398ダウンロード数はclawskills.shが公開している値です
0閲覧数
0件のいいねサインインするとこのスキルにいいねできます
—まだ評価がありません
あなたの評価

概要

Guide skill for controlling native Windows apps (UIA) and web browsers (Playwright) via the handsfree-windows CLI.

説明

このスキルでできること

Controls native Windows desktop apps and web browsers from the command line using the handsfree-windows CLI. Handles UI automation via Windows UIA for desktop apps and Playwright for browsers. Supports recording and replaying YAML macros that mix desktop and browser steps.

Combining UIA desktop control and Playwright browser automation in a single CLI with a shared macro format removes the need to maintain two separate automation toolchains.

使いどころ

  • Automating multi-step data entry in a Windows desktop app
  • Running end-to-end browser tests without writing test framework code
  • Discovering UI controls in an unfamiliar Windows app before scripting it
  • Recording a mixed desktop-and-web workflow as a reusable YAML macro
  • Taking browser screenshots or snapshots for verification during automation

ワークフロー例

入力

User asks: open the company intranet in the browser, click 'Submit Report', then confirm the desktop notification appeared in Outlook

エージェント
  1. 1

    Run hf browser-open --url https://intranet.example.com to open the URL in the managed browser profile

  2. 2

    Run hf browser-snapshot --fmt text to inspect the page and locate the Submit Report button

  3. 3

    Run hf browser-click --text "Submit Report" to click it

  4. 4

    Run hf start --app "Outlook" then hf tree --title-regex "Outlook" --depth 5 to discover notification controls

  5. 5

    Run hf inspect --json to confirm the notification element is present

出力

Browser action completed and Outlook notification element confirmed via UIA tree

要件

  • Python (to run setup.py and scripts)
  • Windows operating system

インストール

clawhub install lijinlar/handsfree-windows-control

CLIコマンドを実行するか、Claude Code、Cursor、Codexなどお使いのコーディングエージェントにプロンプトを貼り付けてください。

リンク