decodo-scraper
donatasdecodo 제작
Web & Frontend Development요약
Search Google, scrape web pages, Amazon product pages, YouTube subtitles, or Reddit (post/subreddit)
설명
이 스킬이 하는 일
Connects to the Decodo Web Scraping API to search Google, scrape arbitrary web pages, fetch Amazon product data, retrieve YouTube transcripts, and read Reddit posts or subreddits. Each target returns structured output suited for programmatic use: JSON for search and Amazon results, markdown for pages, plain text for transcripts.
Handles JavaScript-rendered pages and structured parsers for Google, Amazon, and Reddit that raw HTTP requests cannot replicate.
사용 시점
- Looking up current prices and specs for a product on Amazon before buying
- Pulling a YouTube video transcript to summarize or translate
- Checking what a subreddit is currently discussing without opening a browser
- Running a Google search and extracting organic results for further processing
- Scraping a documentation page or article into clean markdown for an LLM prompt
예시 워크플로
User asks: find the top Google results for 'open source LLM benchmarks' and summarize the snippets
- 1
Runs scrape.py with --target google_search --query 'open source LLM benchmarks'
- 2
Receives JSON with organic, related_questions, and related_searches sections
- 3
Extracts titles and snippets from the organic array
- 4
Compiles a summary from the top results
A list of the top organic results with titles, URLs, and snippets summarized in plain text
요구 사항
- DECODO_AUTH_TOKEN environment variable (Basic auth token from Decodo Dashboard under Scraping APIs)
설치
clawhub install donatasdecodo/decodo-scraperCLI 명령을 실행하거나, 프롬프트를 Claude Code, Cursor, Codex 등 사용하는 코딩 에이전트에 붙여넣으세요.