playwright-scraper-skill-1-2-0
itsjustfred 제작
Web & Frontend Development요약
Playwright-based web scraping OpenClaw Skill with anti-bot protection.
설명
이 스킬이 하는 일
Web scraping skill using Playwright with anti-bot bypass techniques. Supports three scraping modes: built-in fetch for simple sites, Playwright Simple for JavaScript-rendered pages, and Playwright Stealth for Cloudflare-protected sites. Stealth mode hides automation markers and uses realistic device user agents.
Playwright Stealth achieves 100% success on Cloudflare-protected sites where standard scrapers, Crawlee, and Puppeteer all fail.
사용 시점
- Scraping Cloudflare-protected forums and community sites
- Extracting content from JavaScript-heavy single-page apps
- Automating data collection from sites that block standard scrapers
- Taking screenshots and saving HTML snapshots of dynamic pages
- Bypassing 403 errors when web_fetch returns blocked responses
예시 워크플로
User asks: scrape the hot posts from https://m.discuss.com.hk/#hot
- 1
Identifies site as Cloudflare-protected based on domain
- 2
Runs playwright-stealth.js with the target URL
- 3
Script injects init scripts to hide navigator.webdriver and sets iPhone user agent
- 4
Waits with randomized delays to mimic human browsing
- 5
Returns JSON output with title and content, plus saves screenshot and HTML
JSON object with page title, extracted content, and elapsed time; screenshot and HTML saved to disk
설치
clawhub install itsjustfred/playwright-scraper-skill-1-2-0CLI 명령을 실행하거나, 프롬프트를 Claude Code, Cursor, Codex 등 사용하는 코딩 에이전트에 붙여넣으세요.