anycrawl
by techlaai
Browser & AutomationBrief
AnyCrawl API integration for OpenClaw - Scrape, Crawl, and Search web.
Description
What This Skill Does
AnyCrawl provides an API for scraping individual URLs, crawling entire websites, and searching Google. It converts web content into markdown, HTML, or structured JSON for use in AI workflows. Supports static pages via Cheerio and JavaScript-rendered apps via Playwright or Puppeteer.
One API handles both static HTML and JavaScript-rendered pages, removing the need to maintain separate scraping tools for different site types.
When to Use It
- Extracting product prices from e-commerce pages
- Crawling a documentation site to build a local knowledge base
- Searching Google and scraping top results for research summaries
- Pulling structured job listing data from career sites
- Monitoring a competitor blog for new content
Example Workflow
User asks: What are the current pricing plans on this SaaS website?
- 1
Call anycrawl_scrape with the pricing page URL and cheerio engine
- 2
Pass json_options with a schema for plan name, price, and features
- 3
Receive structured JSON with extracted pricing tiers
- 4
Return formatted pricing data to the user
Structured list of pricing plans with names, prices, and included features
Requirements
- ANYCRAWL_API_KEY environment variable
- AnyCrawl account at anycrawl.dev
Installation
clawhub install techlaai/anycrawlRun the CLI command, or paste the prompt into Claude Code, Cursor, Codex or whichever coding agent you use.