crawl4ai
codylrn804 द्वारा
Web & Frontend Developmentसंक्षिप्त
AI-powered web scraping framework for extracting structured data from websites.
विवरण
यह स्किल क्या करती है
Crawl4ai is a Python web scraping framework that combines browser automation with AI-assisted parsing to extract structured data from websites. It handles JavaScript-rendered pages, injects custom JS, and outputs clean markdown, HTML, or structured JSON.
Handles JavaScript-rendered content natively without requiring a separate browser driver setup, unlike BeautifulSoup or Scrapy alone.
इसे कब इस्तेमाल करें
- Scraping product prices and names from an e-commerce site
- Extracting article titles from a news or blog page
- Pulling form data from a page that loads via JavaScript
- Cleaning and converting messy HTML into readable markdown
- Batch scraping multiple URLs in a single session
उदाहरण वर्कफ़्लो
User asks: Extract all product names and prices from this e-commerce URL
- 1
Instantiate AsyncWebCrawler with headless browser mode
- 2
Run crawler on the URL with javascript=true and a custom js_code selector targeting product elements
- 3
Receive extracted_content with structured name/price fields
- 4
Filter and normalize the returned array into a clean list
JSON array of objects each containing product name and price
इंस्टॉलेशन
clawhub install codylrn804/crawl4aiCLI कमांड चलाएँ, या प्रॉम्प्ट को Claude Code, Cursor, Codex या जो भी कोडिंग एजेंट आप इस्तेमाल करते हैं उसमें पेस्ट करें।