desearch-crawl
okradze द्वारा
Web & Frontend Developmentसंक्षिप्त
Crawl/scrape and extract content from any webpage URL.
विवरण
यह स्किल क्या करती है
Crawls a webpage by URL and returns its content as clean text or raw HTML. Powered by the Desearch API. Useful when an agent needs to read the full contents of a specific page rather than search for it.
Returns clean, markup-free text by default, which keeps agent context lean compared to raw HTML scrapers.
इसे कब इस्तेमाल करें
- Reading a documentation page before writing code
- Extracting article text for summarization
- Fetching a competitor's pricing page for comparison
- Pulling release notes from a changelog URL
- Checking the current content of a web page before editing
उदाहरण वर्कफ़्लो
User asks: summarize the Python 3 tutorial index
- 1
Call crawl with 'https://docs.python.org/3/tutorial/index.html' and default text format
- 2
Receive plain text content of the page
- 3
Parse section headings and descriptions from the text
- 4
Compose a summary from the extracted content
A structured summary of the Python 3 tutorial sections
आवश्यकताएँ
- DESEARCH_API_KEY environment variable
- Desearch account at console.desearch.ai (paid balance required)
इंस्टॉलेशन
clawhub install okradze/desearch-crawlCLI कमांड चलाएँ, या प्रॉम्प्ट को Claude Code, Cursor, Codex या जो भी कोडिंग एजेंट आप इस्तेमाल करते हैं उसमें पेस्ट करें।