decodo-scraper-skill
donatasdecodo tarafından
Web & Frontend DevelopmentÖzet
Search Google, scrape web pages, Amazon product pages, YouTube subtitles, or Reddit (post/subreddit)
Açıklama
Bu Beceri Ne Yapar
Connects to the Decodo Web Scraping API to run Google searches, scrape web pages, fetch Amazon product data, retrieve YouTube transcripts, and read Reddit posts or subreddits. Each target returns structured output: markdown for pages, JSON for search results and Amazon data, plain text for transcripts.
Handles JavaScript-rendered pages and anti-bot measures through Decodo's API, avoiding the need to manage headless browsers or proxy rotation yourself.
Ne Zaman Kullanılır
- Pulling Google search results into a research pipeline
- Scraping competitor product prices from Amazon
- Getting transcripts from YouTube videos without manual copying
- Reading Reddit thread discussions for sentiment or topic analysis
- Extracting web page content as markdown for LLM context
Örnek İş Akışı
User asks: summarize the top Reddit discussion about the latest iPhone release
- 1
Search Google with query 'iPhone release reddit discussion' to find relevant post URLs
- 2
Identify the most relevant Reddit post URL from organic results
- 3
Call reddit_post target with the post URL to fetch thread content as JSON
- 4
Extract top comments and post body from the JSON response
- 5
Summarize the key opinions and themes from the thread
A summary of the Reddit thread highlighting the main user reactions, complaints, and praise about the iPhone release
Gereksinimler
- DECODO_AUTH_TOKEN environment variable (Basic auth token from Decodo Dashboard under Scraping APIs)
Kurulum
clawhub install donatasdecodo/decodo-scraper-skillCLI komutunu çalıştırın ya da istemi Claude Code, Cursor, Codex veya kullandığınız kodlama ajanına yapıştırın.