Bỏ qua tới nội dung
TakoAPI
Quay lại kỹ năng

midscene-computer-browser

bởi quanru

Web & Frontend Development
305Lượt tải do clawskills.sh công bố
1Lượt xem
0 lượt thíchĐăng nhập để thích kỹ năng này
—Chưa có đánh giá
Đánh giá của bạn

Tóm tắt

Vision-driven browser automation using Midscene.

Mô tả

Kỹ năng này làm gì

Vision-driven browser automation that operates from screenshots alone, without needing DOM access or accessibility labels. Launches headless Chrome via Puppeteer and interacts with any visible page element using natural language instructions. Works across any frontend technology stack.

Works from screenshots alone, so it handles any frontend stack without needing DOM access, custom selectors, or accessibility attributes.

Khi nào nên dùng

  • Scraping product prices from e-commerce pages
  • Filling and submitting multi-step online forms
  • Taking screenshots of web pages for review or archiving
  • Verifying UI behavior after a deployment
  • Extracting data from paginated tables or dashboards

Quy trình ví dụ

ĐẦU VÀO

User asks: Get the titles of the top 5 articles on Hacker News

AGENT
  1. 1

    Connect to https://news.ycombinator.com

  2. 2

    Take a screenshot to confirm the page has loaded

  3. 3

    Act: read the titles of the top 5 articles from the page

  4. 4

    Close the browser

ĐẦU RA

List of the top 5 Hacker News article titles extracted from the page

Yêu cầu

  • MIDSCENE_MODEL_API_KEY environment variable (API key from a supported vision model provider)
  • MIDSCENE_MODEL_NAME environment variable
  • MIDSCENE_MODEL_BASE_URL environment variable
  • MIDSCENE_MODEL_FAMILY environment variable

Cài đặt

clawhub install quanru/midscene-computer-browser

Chạy lệnh CLI, hoặc dán prompt vào Claude Code, Cursor, Codex hay coding agent bạn đang dùng.

Liên kết