跳到正文
TakoAPI
返回技能列表

scrapling-fetcher

由 damirikys 提供

Web & Frontend Development
542下载量由 clawskills.sh 提供
0浏览量
0 个赞登录后即可为这个技能点赞
—暂无评分
你的评分

简介

Web scraping using Scrapling — a Python framework with anti-bot bypass (Cloudflare Turnstile, fingerprint.

描述

该技能的功能

Scrapling is a Python web scraping framework with built-in anti-bot bypass, including Cloudflare Turnstile handling and browser fingerprint spoofing. It offers three fetcher modes: fast HTTP, stealth headless Chrome, and full dynamic browser for JS-heavy pages. Use it when standard fetch tools return 403s or Cloudflare challenges.

Unlike standard HTTP clients or plain Playwright, Scrapling combines TLS fingerprint spoofing, adaptive element tracking, and Cloudflare bypass in a single tool with a consistent CLI interface.

何时使用

  • Extracting product prices from sites that block scrapers
  • Scraping article content from JS-rendered news sites
  • Pulling structured data from pages behind Cloudflare
  • Automating data collection from SPAs with heavy JavaScript
  • Fetching paginated listings when HTTP requests return bot challenges

示例工作流

输入

User asks: get all H2 headings from a Cloudflare-protected page as JSON

智能体
  1. 1

    Run scrape.py with the target URL, --mode stealth, --selector 'h2', and --json flags

  2. 2

    Scrapling launches headless Chromium via patchright with anti-detect settings

  3. 3

    Page loads fully, bypassing Cloudflare challenge

  4. 4

    CSS selector extracts all matching H2 elements

  5. 5

    Results are serialized to JSON and returned

输出

JSON array of H2 text strings from the page

前置要求

  • scrapling[all] Python package installed via pip
  • patchright Chromium binary installed via 'patchright install chromium'

安装

clawhub install damirikys/scrapling-fetcher

运行 CLI 命令,或把这段提示词粘贴到 Claude Code、Cursor、Codex 或你在用的任意编程智能体里。

链接