본문으로 건너뛰기
TakoAPI
스킬로 돌아가기

playwright-scraper-skill

waisimon 제작

Web & Frontend Development
17.1kclawskills.sh가 보고한 다운로드 수
38스타
20조회수
좋아요 0개로그인하면 이 스킬에 좋아요를 누를 수 있습니다
—아직 평가 없음
내 평가

요약

Playwright-based web scraping OpenClaw Skill with anti-bot protection.

설명

이 스킬이 하는 일

Playwright-based scraper with three tiers of anti-bot handling. Covers static pages via built-in fetch, JavaScript-rendered pages via standard Playwright, and Cloudflare-protected sites via a stealth mode that masks automation markers and mimics real device behavior.

Playwright Stealth achieved 100% success on Cloudflare-protected sites where Crawlee, standard Puppeteer, and Rust-based alternatives all failed with 0-20% success rates.

사용 시점

  • Scraping content from Cloudflare-protected forums
  • Extracting data from JavaScript-rendered e-commerce pages
  • Monitoring dynamic news sites that block standard crawlers
  • Saving HTML snapshots of pages requiring JS execution
  • Collecting structured data from community discussion boards

예시 워크플로

입력

User asks: scrape the top posts from https://m.discuss.com.hk/#hot

에이전트
  1. 1

    Identifies the site uses Cloudflare anti-bot protection

  2. 2

    Selects playwright-stealth.js as the appropriate script

  3. 3

    Runs the script with the target URL

  4. 4

    Script sets a realistic mobile User-Agent, hides webdriver markers, and adds random delays to mimic human behavior

  5. 5

    Returns JSON with page title and content, saves screenshot.png and page.html locally

출력

JSON object with url, title, and content fields, plus screenshot and HTML file saved to disk

요구 사항

  • Playwright Chromium browser (installed via npx playwright install chromium)

설치

clawhub install waisimon/playwright-scraper-skill

CLI 명령을 실행하거나, 프롬프트를 Claude Code, Cursor, Codex 등 사용하는 코딩 에이전트에 붙여넣으세요.

링크