İçeriğe geç
TakoAPI
Becerilere dön

firecrawler

capt-marbles tarafından

Web & Frontend Development
3.1kİndirme sayıları clawskills.sh tarafından bildirilir
2Yıldızlar
1Görüntülenmeler
0 beğeniBu beceriyi beğenmek için giriş yapın
—Henüz değerlendirilmedi
Puanınız

Özet

Web scraping and crawling with Firecrawl API.

Açıklama

Bu Beceri Ne Yapar

Wraps the Firecrawl API to fetch web pages as clean markdown, capture full-page screenshots, extract structured data using a JSON schema, search the web, and crawl documentation sites. Handles JavaScript-rendered content that basic HTTP requests cannot read. Free tier includes 500 credits; each page, screenshot, or search costs 1 credit.

Firecrawl renders JavaScript before returning content, so it works on modern SPAs and dynamic pages where curl or requests would return an empty shell.

Ne Zaman Kullanılır

  • Summarizing a blog post or article from a URL
  • Capturing a screenshot of a live website for design reference
  • Pulling product name, price, and features from an e-commerce page
  • Crawling a framework's docs before starting a new project
  • Mapping all URLs on a site to plan what to scrape

Örnek İş Akışı

GİRİŞ

User asks: 'Extract the name, price, and features from https://example.com/product'

AJAN
  1. 1

    Define a JSON schema with name, price, and features fields

  2. 2

    Run fc.py extract against the product URL with the schema file

  3. 3

    Firecrawl renders the page and maps content to the schema

  4. 4

    Return the structured JSON to the user

ÇIKIŞ

JSON object with name as a string, price as a number, and features as an array of strings

Gereksinimler

  • Firecrawl API key from firecrawl.dev/app/api-keys
  • FIRECRAWL_API_KEY environment variable set to the key value
  • Paid Firecrawl subscription for web search (free tier does not include it)

Kurulum

clawhub install capt-marbles/firecrawler

CLI komutunu çalıştırın ya da istemi Claude Code, Cursor, Codex veya kullandığınız kodlama ajanına yapıştırın.

Bağlantılar