youtube-knowledge-extractor
от sdrabent
Coding Agents & IDEsКратко
Multimodal YouTube video analysis through both audio (transcript) and visual (frame extraction + image analysis)
Описание
Что делает этот навык
Analyzes YouTube videos through both audio and visual channels by extracting timestamped transcripts and key frames from the video. Pairs spoken content with on-screen visuals, so UI actions, code, and diagrams shown but not described in speech are captured accurately.
Standard YouTube transcript tools miss anything shown on screen but not spoken; this skill matches frames to transcript timestamps to close that gap.
Когда его использовать
- Building step-by-step guides from software tutorial videos
- Extracting code shown on screen during live coding demos
- Summarizing long explainer videos with visual anchors
- Following UI navigation in product walkthrough videos
- Capturing diagram details from architecture or design videos
Пример сценария
User asks: 'Create a step-by-step guide from this YouTube tutorial: https://youtube.com/watch?v=...'
- 1
Fetches video metadata (title, duration, ID) using yt-dlp
- 2
Extracts timestamped transcript via yt-dlp JSON dump and curl
- 3
Downloads video at 720p and extracts frames at adaptive intervals using ffmpeg
- 4
Synchronizes each frame to its corresponding transcript segment by timestamp
- 5
Reads each frame for on-screen text, UI elements, and code, then combines with audio to generate a structured guide
Timestamped step-by-step guide with descriptions combining spoken instructions and visible UI details, including button names, menu paths, and code shown on screen
Требования
- ffmpeg installed on system
- yt-dlp installed on system
Установка
clawhub install sdrabent/youtube-knowledge-extractorВыполните команду CLI или вставьте промпт в Claude Code, Cursor, Codex — любой кодинг-агент, которым пользуетесь.