Skip to content
TakoAPI
Back to skills

desearch-crawl

by okradze

Web & Frontend Development
553Downloads reported by clawskills.sh
0Views
0 likesSign in to like this skill
—Not yet rated
Your rating

Brief

Crawl/scrape and extract content from any webpage URL.

Description

What This Skill Does

Crawls a webpage by URL and returns its content as clean text or raw HTML. Powered by the Desearch API. Useful when an agent needs to read the full contents of a specific page rather than search for it.

Returns clean, markup-free text by default, which keeps agent context lean compared to raw HTML scrapers.

When to Use It

  • Reading a documentation page before writing code
  • Extracting article text for summarization
  • Fetching a competitor's pricing page for comparison
  • Pulling release notes from a changelog URL
  • Checking the current content of a web page before editing

Example Workflow

INPUT

User asks: summarize the Python 3 tutorial index

AGENT
  1. 1

    Call crawl with 'https://docs.python.org/3/tutorial/index.html' and default text format

  2. 2

    Receive plain text content of the page

  3. 3

    Parse section headings and descriptions from the text

  4. 4

    Compose a summary from the extracted content

OUTPUT

A structured summary of the Python 3 tutorial sections

Requirements

  • DESEARCH_API_KEY environment variable
  • Desearch account at console.desearch.ai (paid balance required)

Installation

clawhub install okradze/desearch-crawl

Run the CLI command, or paste the prompt into Claude Code, Cursor, Codex or whichever coding agent you use.

Links