Skip to content
TakoAPI
Back to skills

xdotool-control

by jeremysommerfeld8910-cpu

Browser & Automation
430Downloads reported by clawskills.sh
0Views
0 likesSign in to like this skill
—Not yet rated
Your rating

Brief

Mouse and keyboard automation using xdotool.

Description

What This Skill Does

Mouse, keyboard, and window automation for Linux desktops using xdotool. Covers clicking at screen coordinates, typing into GUI apps, switching browser tabs, and running screenshot-verify-click loops. Works when browser CDP is unavailable.

Handles desktop UI automation directly on Linux without requiring a browser debugging protocol or remote relay.

When to Use It

  • Clicking Chrome extension icons by name
  • Typing commands into a terminal window
  • Switching browser tabs without a relay
  • Automating desktop GUI interactions via coordinate clicks
  • Running screenshot loops to verify and click UI elements

Example Workflow

INPUT

User asks: click the OpenClaw extension icon in Chrome

AGENT
  1. 1

    Run xdotool getdisplaygeometry to get screen dimensions

  2. 2

    Take a toolbar screenshot with scrot to verify icon positions

  3. 3

    Find and focus the Chrome window with xdotool search and windowactivate --sync

  4. 4

    Wait 0.3s for focus to settle

  5. 5

    Click the extension icon coordinates with xdotool mousemove and click 1

OUTPUT

Chrome extension icon clicked at the correct toolbar position

Installation

clawhub install jeremysommerfeld8910-cpu/xdotool-control

Run the CLI command, or paste the prompt into Claude Code, Cursor, Codex or whichever coding agent you use.

Links