anycrawl
由 techlaai 提供
Browser & Automation简介
AnyCrawl API integration for OpenClaw - Scrape, Crawl, and Search web.
描述
该技能的功能
AnyCrawl provides an API for scraping individual URLs, crawling entire websites, and searching Google. It converts web content into markdown, HTML, or structured JSON for use in AI workflows. Supports static pages via Cheerio and JavaScript-rendered apps via Playwright or Puppeteer.
One API handles both static HTML and JavaScript-rendered pages, removing the need to maintain separate scraping tools for different site types.
何时使用
- Extracting product prices from e-commerce pages
- Crawling a documentation site to build a local knowledge base
- Searching Google and scraping top results for research summaries
- Pulling structured job listing data from career sites
- Monitoring a competitor blog for new content
示例工作流
User asks: What are the current pricing plans on this SaaS website?
- 1
Call anycrawl_scrape with the pricing page URL and cheerio engine
- 2
Pass json_options with a schema for plan name, price, and features
- 3
Receive structured JSON with extracted pricing tiers
- 4
Return formatted pricing data to the user
Structured list of pricing plans with names, prices, and included features
前置要求
- ANYCRAWL_API_KEY environment variable
- AnyCrawl account at anycrawl.dev
安装
clawhub install techlaai/anycrawl运行 CLI 命令,或把这段提示词粘贴到 Claude Code、Cursor、Codex 或你在用的任意编程智能体里。