sovereign-content-scraper
by ryudi84
Coding Agents & IDEsBrief
You are a trend-monitoring content researcher.
Description
What This Skill Does
Monitors X/Twitter, Reddit, RSS feeds, and YouTube daily to surface trending topics and viral content in a defined niche. Outputs a structured JSON report with content ideas, viral formats, and engagement evidence. Runs on a schedule and saves results locally.
Replaces manually checking four platforms each morning with a single automated report that surfaces high-engagement signals and content gaps in one place.
When to Use It
- Finding trending angles before writing a newsletter
- Spotting unanswered questions in a subreddit before launching a product
- Identifying viral tweet formats to adapt for your own content
- Reviewing what YouTube creators are covering this week in your niche
- Building a weekly content calendar from a daily trend digest
Example Workflow
User asks: Find trending topics in the indie hacking niche for today
- 1
Reads sources.json to get configured subreddits, RSS feeds, keywords, and optional Twitter credentials
- 2
Searches X/Twitter for niche keywords, filters tweets with likes > 100 and retweets > 20
- 3
Fetches top Reddit posts from specified subreddits over the past 24 hours and scans comments for pain points
- 4
Checks RSS feeds for new articles and summarizes key angles not yet covered
- 5
Saves structured report to data/trend-report-{date}.json with trending topics, content ideas, and viral formats
JSON report listing trending topics by source, 3-5 content ideas with hooks and key points, and viral format examples performing well this week
Requirements
- Twitter API credentials (optional, required only for X/Twitter keyword search)
Installation
clawhub install ryudi84/sovereign-content-scraperRun the CLI command, or paste the prompt into Claude Code, Cursor, Codex or whichever coding agent you use.