anycrawl
techlaai tarafından
Browser & AutomationÖzet
AnyCrawl API integration for OpenClaw - Scrape, Crawl, and Search web.
Açıklama
Bu Beceri Ne Yapar
AnyCrawl provides an API for scraping individual URLs, crawling entire websites, and searching Google. It converts web content into markdown, HTML, or structured JSON for use in AI workflows. Supports static pages via Cheerio and JavaScript-rendered apps via Playwright or Puppeteer.
One API handles both static HTML and JavaScript-rendered pages, removing the need to maintain separate scraping tools for different site types.
Ne Zaman Kullanılır
- Extracting product prices from e-commerce pages
- Crawling a documentation site to build a local knowledge base
- Searching Google and scraping top results for research summaries
- Pulling structured job listing data from career sites
- Monitoring a competitor blog for new content
Örnek İş Akışı
User asks: What are the current pricing plans on this SaaS website?
- 1
Call anycrawl_scrape with the pricing page URL and cheerio engine
- 2
Pass json_options with a schema for plan name, price, and features
- 3
Receive structured JSON with extracted pricing tiers
- 4
Return formatted pricing data to the user
Structured list of pricing plans with names, prices, and included features
Gereksinimler
- ANYCRAWL_API_KEY environment variable
- AnyCrawl account at anycrawl.dev
Kurulum
clawhub install techlaai/anycrawlCLI komutunu çalıştırın ya da istemi Claude Code, Cursor, Codex veya kullandığınız kodlama ajanına yapıştırın.