본문으로 건너뛰기
TakoAPI
스킬로 돌아가기

webscraper-pulpminer

melvin2016 제작

Web & Frontend Development
893clawskills.sh가 보고한 다운로드 수
4스타
0조회수
좋아요 0개로그인하면 이 스킬에 좋아요를 누를 수 있습니다
—아직 평가 없음
내 평가

요약

Convert any webpage into structured JSON data using AI.

설명

이 스킬이 하는 일

PulpMiner converts any webpage into structured JSON using AI. You provide a URL and an optional JSON schema, and it scrapes the page, processes it through an LLM, and returns clean data. APIs can be saved and called programmatically with static or dynamic URLs.

Handles JavaScript-rendered SPAs and lets you define exact output schemas, which removes the need to write and maintain custom scraper code.

사용 시점

  • Track competitor prices across e-commerce pages
  • Extract lead contact info from company directories
  • Monitor job listings for new postings
  • Pull structured product data from vendor catalogs
  • Scrape paginated search results with dynamic query variables

예시 워크플로

입력

User asks: extract the name, price, and availability of every product on this page

에이전트
  1. 1

    Open the PulpMiner dashboard and create a saved API for the target URL

  2. 2

    Set a JSON template matching the desired output structure, e.g. {"name":"","price":"","available":""}

  3. 3

    Enable JS rendering if the page loads products dynamically

  4. 4

    Call the saved API endpoint with the PULPMINER_API_KEY header

  5. 5

    Return the structured JSON array from the response data field

출력

A JSON array of product objects with name, price, and availability fields

요구 사항

  • PULPMINER_API_KEY from pulpminer.com/api
  • PulpMiner account with sufficient credits (0.25-0.4 credits per call)

설치

clawhub install melvin2016/webscraper-pulpminer

CLI 명령을 실행하거나, 프롬프트를 Claude Code, Cursor, Codex 등 사용하는 코딩 에이전트에 붙여넣으세요.

링크