smart-web-scraper
mariusfit 제작
Web & Frontend Development요약
Extract structured data from any web page.
설명
이 스킬이 하는 일
Extracts structured data from web pages using CSS selectors or automatic detection of tables and lists. Outputs results as JSON, CSV, text, or Markdown. Supports multi-page crawling with pagination following.
Auto-installs its own dependencies via uv, so there is no manual setup before scraping a page.
사용 시점
- Pulling product names and prices from an e-commerce listing
- Extracting all external links from a documentation site
- Scraping a pricing table into a spreadsheet-ready CSV
- Collecting article headlines across multiple paginated pages
- Grabbing contact details from a directory page
예시 워크플로
User asks: extract all products from https://shop.example.com as JSON
- 1
Run the extract command with the shop URL and a CSS selector targeting product elements
- 2
Specify JSON output format with the -f json flag
- 3
Save the output to a local file using -o products.json
- 4
Review the resulting JSON array for product text and tag data
A products.json file containing a JSON array with each product's text, tag, and class attributes
설치
clawhub install mariusfit/smart-web-scraperCLI 명령을 실행하거나, 프롬프트를 Claude Code, Cursor, Codex 등 사용하는 코딩 에이전트에 붙여넣으세요.