कंटेंट पर जाएँ
TakoAPI
स्किल्स पर वापस

playwright-scraper-skill

waisimon द्वारा

Web & Frontend Development
17.1kclawskills.sh द्वारा बताए गए डाउनलोड
38स्टार
20व्यूज़
0 लाइकइस स्किल को लाइक करने के लिए साइन इन करें
—अभी तक कोई रेटिंग नहीं
आपकी रेटिंग

संक्षिप्त

Playwright-based web scraping OpenClaw Skill with anti-bot protection.

विवरण

यह स्किल क्या करती है

Playwright-based scraper with three tiers of anti-bot handling. Covers static pages via built-in fetch, JavaScript-rendered pages via standard Playwright, and Cloudflare-protected sites via a stealth mode that masks automation markers and mimics real device behavior.

Playwright Stealth achieved 100% success on Cloudflare-protected sites where Crawlee, standard Puppeteer, and Rust-based alternatives all failed with 0-20% success rates.

इसे कब इस्तेमाल करें

  • Scraping content from Cloudflare-protected forums
  • Extracting data from JavaScript-rendered e-commerce pages
  • Monitoring dynamic news sites that block standard crawlers
  • Saving HTML snapshots of pages requiring JS execution
  • Collecting structured data from community discussion boards

उदाहरण वर्कफ़्लो

इनपुट

User asks: scrape the top posts from https://m.discuss.com.hk/#hot

एजेंट
  1. 1

    Identifies the site uses Cloudflare anti-bot protection

  2. 2

    Selects playwright-stealth.js as the appropriate script

  3. 3

    Runs the script with the target URL

  4. 4

    Script sets a realistic mobile User-Agent, hides webdriver markers, and adds random delays to mimic human behavior

  5. 5

    Returns JSON with page title and content, saves screenshot.png and page.html locally

आउटपुट

JSON object with url, title, and content fields, plus screenshot and HTML file saved to disk

आवश्यकताएँ

  • Playwright Chromium browser (installed via npx playwright install chromium)

इंस्टॉलेशन

clawhub install waisimon/playwright-scraper-skill

CLI कमांड चलाएँ, या प्रॉम्प्ट को Claude Code, Cursor, Codex या जो भी कोडिंग एजेंट आप इस्तेमाल करते हैं उसमें पेस्ट करें।

लिंक