تخطَّ إلى المحتوى
TakoAPI
العودة إلى المهارات

webscraper-pulpminer

بواسطة melvin2016

Web & Frontend Development
893التنزيلات وفق ما يذكره clawskills.sh
4النجوم
0المشاهدات
لا إعجاباتسجّل الدخول للإعجاب بهذه المهارة
—لم يُقيَّم بعد
تقييمك

موجز

Convert any webpage into structured JSON data using AI.

الوصف

ما الذي تفعله هذه المهارة

PulpMiner converts any webpage into structured JSON using AI. You provide a URL and an optional JSON schema, and it scrapes the page, processes it through an LLM, and returns clean data. APIs can be saved and called programmatically with static or dynamic URLs.

Handles JavaScript-rendered SPAs and lets you define exact output schemas, which removes the need to write and maintain custom scraper code.

متى تستخدمها

  • Track competitor prices across e-commerce pages
  • Extract lead contact info from company directories
  • Monitor job listings for new postings
  • Pull structured product data from vendor catalogs
  • Scrape paginated search results with dynamic query variables

مثال على سير العمل

الإدخال

User asks: extract the name, price, and availability of every product on this page

الوكيل
  1. 1

    Open the PulpMiner dashboard and create a saved API for the target URL

  2. 2

    Set a JSON template matching the desired output structure, e.g. {"name":"","price":"","available":""}

  3. 3

    Enable JS rendering if the page loads products dynamically

  4. 4

    Call the saved API endpoint with the PULPMINER_API_KEY header

  5. 5

    Return the structured JSON array from the response data field

الإخراج

A JSON array of product objects with name, price, and availability fields

المتطلبات

  • PULPMINER_API_KEY from pulpminer.com/api
  • PulpMiner account with sufficient credits (0.25-0.4 credits per call)

التثبيت

clawhub install melvin2016/webscraper-pulpminer

شغّل أمر واجهة سطر الأوامر، أو الصق النص في Claude Code أو Cursor أو Codex أو أي وكيل برمجة تستخدمه.

الروابط