跳到正文
TakoAPI
返回技能列表

webscraper-pulpminer

由 melvin2016 提供

Web & Frontend Development
893下载量由 clawskills.sh 提供
4星标
0浏览量
0 个赞登录后即可为这个技能点赞
—暂无评分
你的评分

简介

Convert any webpage into structured JSON data using AI.

描述

该技能的功能

PulpMiner converts any webpage into structured JSON using AI. You provide a URL and an optional JSON schema, and it scrapes the page, processes it through an LLM, and returns clean data. APIs can be saved and called programmatically with static or dynamic URLs.

Handles JavaScript-rendered SPAs and lets you define exact output schemas, which removes the need to write and maintain custom scraper code.

何时使用

  • Track competitor prices across e-commerce pages
  • Extract lead contact info from company directories
  • Monitor job listings for new postings
  • Pull structured product data from vendor catalogs
  • Scrape paginated search results with dynamic query variables

示例工作流

输入

User asks: extract the name, price, and availability of every product on this page

智能体
  1. 1

    Open the PulpMiner dashboard and create a saved API for the target URL

  2. 2

    Set a JSON template matching the desired output structure, e.g. {"name":"","price":"","available":""}

  3. 3

    Enable JS rendering if the page loads products dynamically

  4. 4

    Call the saved API endpoint with the PULPMINER_API_KEY header

  5. 5

    Return the structured JSON array from the response data field

输出

A JSON array of product objects with name, price, and availability fields

前置要求

  • PULPMINER_API_KEY from pulpminer.com/api
  • PulpMiner account with sufficient credits (0.25-0.4 credits per call)

安装

clawhub install melvin2016/webscraper-pulpminer

运行 CLI 命令,或把这段提示词粘贴到 Claude Code、Cursor、Codex 或你在用的任意编程智能体里。

链接