본문으로 건너뛰기
TakoAPI
스킬로 돌아가기

scrapling-fetcher

damirikys 제작

Web & Frontend Development
542clawskills.sh가 보고한 다운로드 수
0조회수
좋아요 0개로그인하면 이 스킬에 좋아요를 누를 수 있습니다
—아직 평가 없음
내 평가

요약

Web scraping using Scrapling — a Python framework with anti-bot bypass (Cloudflare Turnstile, fingerprint.

설명

이 스킬이 하는 일

Scrapling is a Python web scraping framework with built-in anti-bot bypass, including Cloudflare Turnstile handling and browser fingerprint spoofing. It offers three fetcher modes: fast HTTP, stealth headless Chrome, and full dynamic browser for JS-heavy pages. Use it when standard fetch tools return 403s or Cloudflare challenges.

Unlike standard HTTP clients or plain Playwright, Scrapling combines TLS fingerprint spoofing, adaptive element tracking, and Cloudflare bypass in a single tool with a consistent CLI interface.

사용 시점

  • Extracting product prices from sites that block scrapers
  • Scraping article content from JS-rendered news sites
  • Pulling structured data from pages behind Cloudflare
  • Automating data collection from SPAs with heavy JavaScript
  • Fetching paginated listings when HTTP requests return bot challenges

예시 워크플로

입력

User asks: get all H2 headings from a Cloudflare-protected page as JSON

에이전트
  1. 1

    Run scrape.py with the target URL, --mode stealth, --selector 'h2', and --json flags

  2. 2

    Scrapling launches headless Chromium via patchright with anti-detect settings

  3. 3

    Page loads fully, bypassing Cloudflare challenge

  4. 4

    CSS selector extracts all matching H2 elements

  5. 5

    Results are serialized to JSON and returned

출력

JSON array of H2 text strings from the page

요구 사항

  • scrapling[all] Python package installed via pip
  • patchright Chromium binary installed via 'patchright install chromium'

설치

clawhub install damirikys/scrapling-fetcher

CLI 명령을 실행하거나, 프롬프트를 Claude Code, Cursor, Codex 등 사용하는 코딩 에이전트에 붙여넣으세요.

링크