Bỏ qua tới nội dung
TakoAPI
Quay lại kỹ năng

playwright-scraper-skill

bởi waisimon

Web & Frontend Development
17.1kLượt tải do clawskills.sh công bố
38Sao
20Lượt xem
0 lượt thíchĐăng nhập để thích kỹ năng này
—Chưa có đánh giá
Đánh giá của bạn

Tóm tắt

Playwright-based web scraping OpenClaw Skill with anti-bot protection.

Mô tả

Kỹ năng này làm gì

Playwright-based scraper with three tiers of anti-bot handling. Covers static pages via built-in fetch, JavaScript-rendered pages via standard Playwright, and Cloudflare-protected sites via a stealth mode that masks automation markers and mimics real device behavior.

Playwright Stealth achieved 100% success on Cloudflare-protected sites where Crawlee, standard Puppeteer, and Rust-based alternatives all failed with 0-20% success rates.

Khi nào nên dùng

  • Scraping content from Cloudflare-protected forums
  • Extracting data from JavaScript-rendered e-commerce pages
  • Monitoring dynamic news sites that block standard crawlers
  • Saving HTML snapshots of pages requiring JS execution
  • Collecting structured data from community discussion boards

Quy trình ví dụ

ĐẦU VÀO

User asks: scrape the top posts from https://m.discuss.com.hk/#hot

AGENT
  1. 1

    Identifies the site uses Cloudflare anti-bot protection

  2. 2

    Selects playwright-stealth.js as the appropriate script

  3. 3

    Runs the script with the target URL

  4. 4

    Script sets a realistic mobile User-Agent, hides webdriver markers, and adds random delays to mimic human behavior

  5. 5

    Returns JSON with page title and content, saves screenshot.png and page.html locally

ĐẦU RA

JSON object with url, title, and content fields, plus screenshot and HTML file saved to disk

Yêu cầu

  • Playwright Chromium browser (installed via npx playwright install chromium)

Cài đặt

clawhub install waisimon/playwright-scraper-skill

Chạy lệnh CLI, hoặc dán prompt vào Claude Code, Cursor, Codex hay coding agent bạn đang dùng.

Liên kết