playwright-scraper-skill
waisimon tarafından
Web & Frontend DevelopmentÖzet
Playwright-based web scraping OpenClaw Skill with anti-bot protection.
Açıklama
Bu Beceri Ne Yapar
Playwright-based scraper with three tiers of anti-bot handling. Covers static pages via built-in fetch, JavaScript-rendered pages via standard Playwright, and Cloudflare-protected sites via a stealth mode that masks automation markers and mimics real device behavior.
Playwright Stealth achieved 100% success on Cloudflare-protected sites where Crawlee, standard Puppeteer, and Rust-based alternatives all failed with 0-20% success rates.
Ne Zaman Kullanılır
- Scraping content from Cloudflare-protected forums
- Extracting data from JavaScript-rendered e-commerce pages
- Monitoring dynamic news sites that block standard crawlers
- Saving HTML snapshots of pages requiring JS execution
- Collecting structured data from community discussion boards
Örnek İş Akışı
User asks: scrape the top posts from https://m.discuss.com.hk/#hot
- 1
Identifies the site uses Cloudflare anti-bot protection
- 2
Selects playwright-stealth.js as the appropriate script
- 3
Runs the script with the target URL
- 4
Script sets a realistic mobile User-Agent, hides webdriver markers, and adds random delays to mimic human behavior
- 5
Returns JSON with page title and content, saves screenshot.png and page.html locally
JSON object with url, title, and content fields, plus screenshot and HTML file saved to disk
Gereksinimler
- Playwright Chromium browser (installed via npx playwright install chromium)
Kurulum
clawhub install waisimon/playwright-scraper-skillCLI komutunu çalıştırın ya da istemi Claude Code, Cursor, Codex veya kullandığınız kodlama ajanına yapıştırın.