youtube-knowledge-extractor
sdrabent 作
Coding Agents & IDEs概要
Multimodal YouTube video analysis through both audio (transcript) and visual (frame extraction + image analysis)
説明
このスキルでできること
Analyzes YouTube videos through both audio and visual channels by extracting timestamped transcripts and key frames from the video. Pairs spoken content with on-screen visuals, so UI actions, code, and diagrams shown but not described in speech are captured accurately.
Standard YouTube transcript tools miss anything shown on screen but not spoken; this skill matches frames to transcript timestamps to close that gap.
使いどころ
- Building step-by-step guides from software tutorial videos
- Extracting code shown on screen during live coding demos
- Summarizing long explainer videos with visual anchors
- Following UI navigation in product walkthrough videos
- Capturing diagram details from architecture or design videos
ワークフロー例
User asks: 'Create a step-by-step guide from this YouTube tutorial: https://youtube.com/watch?v=...'
- 1
Fetches video metadata (title, duration, ID) using yt-dlp
- 2
Extracts timestamped transcript via yt-dlp JSON dump and curl
- 3
Downloads video at 720p and extracts frames at adaptive intervals using ffmpeg
- 4
Synchronizes each frame to its corresponding transcript segment by timestamp
- 5
Reads each frame for on-screen text, UI elements, and code, then combines with audio to generate a structured guide
Timestamped step-by-step guide with descriptions combining spoken instructions and visible UI details, including button names, menu paths, and code shown on screen
要件
- ffmpeg installed on system
- yt-dlp installed on system
インストール
clawhub install sdrabent/youtube-knowledge-extractorCLIコマンドを実行するか、Claude Code、Cursor、Codexなどお使いのコーディングエージェントにプロンプトを貼り付けてください。