smart-web-scraper
由 mariusfit 提供
Web & Frontend Development简介
Extract structured data from any web page.
描述
该技能的功能
Extracts structured data from web pages using CSS selectors or automatic detection of tables and lists. Outputs results as JSON, CSV, text, or Markdown. Supports multi-page crawling with pagination following.
Auto-installs its own dependencies via uv, so there is no manual setup before scraping a page.
何时使用
- Pulling product names and prices from an e-commerce listing
- Extracting all external links from a documentation site
- Scraping a pricing table into a spreadsheet-ready CSV
- Collecting article headlines across multiple paginated pages
- Grabbing contact details from a directory page
示例工作流
User asks: extract all products from https://shop.example.com as JSON
- 1
Run the extract command with the shop URL and a CSS selector targeting product elements
- 2
Specify JSON output format with the -f json flag
- 3
Save the output to a local file using -o products.json
- 4
Review the resulting JSON array for product text and tag data
A products.json file containing a JSON array with each product's text, tag, and class attributes
安装
clawhub install mariusfit/smart-web-scraper运行 CLI 命令,或把这段提示词粘贴到 Claude Code、Cursor、Codex 或你在用的任意编程智能体里。