跳到正文
TakoAPI
返回技能列表

guicountrol

由 dreamtraveler13 提供

Browser & Automation
9.4k下载量由 clawskills.sh 提供
6星标
20浏览量
0 个赞登录后即可为这个技能点赞
—暂无评分
你的评分

简介

Control the Linux desktop GUI using xdotool, wmctrl, and dogtail.

描述

该技能的功能

Automates Linux desktop GUI interactions using xdotool, wmctrl, and dogtail on X11/GNOME. Supports simulating mouse and keyboard input, managing windows, inspecting UI accessibility trees, and taking screenshots for visual analysis.

Combines window management, input simulation, and accessibility tree inspection in one workflow, covering apps that have no API or web interface.

何时使用

  • Automating repetitive clicks in a desktop app that has no CLI or API
  • Resizing and repositioning windows in a scripted workflow
  • Extracting button and input labels from an Electron app without screenshots
  • Navigating a legacy GUI tool using keyboard simulation
  • Taking screenshots of specific windows for automated visual checks

示例工作流

输入

User asks: click the 'Export' button in the desktop app 'MyApp'

智能体
  1. 1

    Run wmctrl -l to list open windows and confirm MyApp is running

  2. 2

    Activate the MyApp window using gui_action.sh activate

  3. 3

    Run scripts/inspect_ui.py to extract the UI tree and locate the Export button

  4. 4

    Use xdotool to click the button coordinates or simulate keyboard navigation to it

  5. 5

    Verify the action completed by re-inspecting the UI tree or taking a screenshot

输出

The Export button is clicked and the export dialog opens

前置要求

  • wmctrl installed on the Linux system
  • xdotool installed on the Linux system
  • dogtail installed on the Linux system
  • scrot installed on the Linux system
  • X11/GNOME desktop environment

安装

clawhub install dreamtraveler13/guicountrol

运行 CLI 命令,或把这段提示词粘贴到 Claude Code、Cursor、Codex 或你在用的任意编程智能体里。

链接