Bỏ qua tới nội dung
TakoAPI
Quay lại kỹ năng

guicountrol

bởi dreamtraveler13

Browser & Automation
9.4kLượt tải do clawskills.sh công bố
6Sao
20Lượt xem
0 lượt thíchĐăng nhập để thích kỹ năng này
—Chưa có đánh giá
Đánh giá của bạn

Tóm tắt

Control the Linux desktop GUI using xdotool, wmctrl, and dogtail.

Mô tả

Kỹ năng này làm gì

Automates Linux desktop GUI interactions using xdotool, wmctrl, and dogtail on X11/GNOME. Supports simulating mouse and keyboard input, managing windows, inspecting UI accessibility trees, and taking screenshots for visual analysis.

Combines window management, input simulation, and accessibility tree inspection in one workflow, covering apps that have no API or web interface.

Khi nào nên dùng

  • Automating repetitive clicks in a desktop app that has no CLI or API
  • Resizing and repositioning windows in a scripted workflow
  • Extracting button and input labels from an Electron app without screenshots
  • Navigating a legacy GUI tool using keyboard simulation
  • Taking screenshots of specific windows for automated visual checks

Quy trình ví dụ

ĐẦU VÀO

User asks: click the 'Export' button in the desktop app 'MyApp'

AGENT
  1. 1

    Run wmctrl -l to list open windows and confirm MyApp is running

  2. 2

    Activate the MyApp window using gui_action.sh activate

  3. 3

    Run scripts/inspect_ui.py to extract the UI tree and locate the Export button

  4. 4

    Use xdotool to click the button coordinates or simulate keyboard navigation to it

  5. 5

    Verify the action completed by re-inspecting the UI tree or taking a screenshot

ĐẦU RA

The Export button is clicked and the export dialog opens

Yêu cầu

  • wmctrl installed on the Linux system
  • xdotool installed on the Linux system
  • dogtail installed on the Linux system
  • scrot installed on the Linux system
  • X11/GNOME desktop environment

Cài đặt

clawhub install dreamtraveler13/guicountrol

Chạy lệnh CLI, hoặc dán prompt vào Claude Code, Cursor, Codex hay coding agent bạn đang dùng.

Liên kết