본문으로 건너뛰기
TakoAPI
스킬로 돌아가기

gpu-cluster-monitor

sounderliu 제작

Web & Frontend Development
295clawskills.sh가 보고한 다운로드 수
0조회수
좋아요 0개로그인하면 이 스킬에 좋아요를 누를 수 있습니다
—아직 평가 없음
내 평가

요약

A high-performance engineering tool for deep web scraping.

설명

이 스킬이 하는 일

A web scraping tool that runs inside a Docker container using Crawlee and Playwright to extract content from sites with anti-bot protections. Targets JavaScript-heavy platforms like YouTube and X/Twitter. Outputs structured JSON with status, content type, and raw data.

Running Playwright inside Docker bypasses bot detection that blocks standard HTTP-based scrapers on protected sites.

사용 시점

  • Extracting transcripts from YouTube videos
  • Scraping posts or threads from X/Twitter
  • Getting raw text from JavaScript-rendered pages
  • Feeding scraped content directly into LLM pipelines
  • Collecting video descriptions in bulk from YouTube

예시 워크플로

입력

User asks: Get the transcript from this YouTube video URL

에이전트
  1. 1

    Validates the YouTube video ID from the provided URL

  2. 2

    Runs the Docker container with the target URL as argument

  3. 3

    Crawlee and Playwright load the page and intercept transcript data

  4. 4

    Parses the JSON output from stdout for status and data fields

출력

JSON object with status SUCCESS, type TRANSCRIPT, videoId, and full transcript text

요구 사항

  • Docker installed and running on the host machine

설치

clawhub install sounderliu/gpu-cluster-monitor

CLI 명령을 실행하거나, 프롬프트를 Claude Code, Cursor, Codex 등 사용하는 코딩 에이전트에 붙여넣으세요.

링크