youtube-knowledge-extractor
di sdrabent
Coding Agents & IDEsSintesi
Multimodal YouTube video analysis through both audio (transcript) and visual (frame extraction + image analysis)
Descrizione
Cosa fa questa skill
Analyzes YouTube videos through both audio and visual channels by extracting timestamped transcripts and key frames from the video. Pairs spoken content with on-screen visuals, so UI actions, code, and diagrams shown but not described in speech are captured accurately.
Standard YouTube transcript tools miss anything shown on screen but not spoken; this skill matches frames to transcript timestamps to close that gap.
Quando usarla
- Building step-by-step guides from software tutorial videos
- Extracting code shown on screen during live coding demos
- Summarizing long explainer videos with visual anchors
- Following UI navigation in product walkthrough videos
- Capturing diagram details from architecture or design videos
Esempio di workflow
User asks: 'Create a step-by-step guide from this YouTube tutorial: https://youtube.com/watch?v=...'
- 1
Fetches video metadata (title, duration, ID) using yt-dlp
- 2
Extracts timestamped transcript via yt-dlp JSON dump and curl
- 3
Downloads video at 720p and extracts frames at adaptive intervals using ffmpeg
- 4
Synchronizes each frame to its corresponding transcript segment by timestamp
- 5
Reads each frame for on-screen text, UI elements, and code, then combines with audio to generate a structured guide
Timestamped step-by-step guide with descriptions combining spoken instructions and visible UI details, including button names, menu paths, and code shown on screen
Requisiti
- ffmpeg installed on system
- yt-dlp installed on system
Installazione
clawhub install sdrabent/youtube-knowledge-extractorEsegui il comando CLI oppure incolla il prompt in Claude Code, Cursor, Codex o nell'agente di coding che usi.