تخطَّ إلى المحتوى
TakoAPI
العودة إلى المهارات

playwright-scraper-skill-1-2-0

بواسطة itsjustfred

Web & Frontend Development
429التنزيلات وفق ما يذكره clawskills.sh
1المشاهدات
لا إعجاباتسجّل الدخول للإعجاب بهذه المهارة
—لم يُقيَّم بعد
تقييمك

موجز

Playwright-based web scraping OpenClaw Skill with anti-bot protection.

الوصف

ما الذي تفعله هذه المهارة

Web scraping skill using Playwright with anti-bot bypass techniques. Supports three scraping modes: built-in fetch for simple sites, Playwright Simple for JavaScript-rendered pages, and Playwright Stealth for Cloudflare-protected sites. Stealth mode hides automation markers and uses realistic device user agents.

Playwright Stealth achieves 100% success on Cloudflare-protected sites where standard scrapers, Crawlee, and Puppeteer all fail.

متى تستخدمها

  • Scraping Cloudflare-protected forums and community sites
  • Extracting content from JavaScript-heavy single-page apps
  • Automating data collection from sites that block standard scrapers
  • Taking screenshots and saving HTML snapshots of dynamic pages
  • Bypassing 403 errors when web_fetch returns blocked responses

مثال على سير العمل

الإدخال

User asks: scrape the hot posts from https://m.discuss.com.hk/#hot

الوكيل
  1. 1

    Identifies site as Cloudflare-protected based on domain

  2. 2

    Runs playwright-stealth.js with the target URL

  3. 3

    Script injects init scripts to hide navigator.webdriver and sets iPhone user agent

  4. 4

    Waits with randomized delays to mimic human browsing

  5. 5

    Returns JSON output with title and content, plus saves screenshot and HTML

الإخراج

JSON object with page title, extracted content, and elapsed time; screenshot and HTML saved to disk

التثبيت

clawhub install itsjustfred/playwright-scraper-skill-1-2-0

شغّل أمر واجهة سطر الأوامر، أو الصق النص في Claude Code أو Cursor أو Codex أو أي وكيل برمجة تستخدمه.

الروابط