llm-reader
von m92vyas
Turn Webpage to LLM friendly input text. Similar to Firecrawl and Jina Reader API. Makes RAG, AI web scraping, image & webpage links extraction easy.
Aus dem README
Webpage to LLM Ready Input Text Pre-processing webpage before giving it as input to the LLM improves extraction/scraping accuracy especially if you want to extract website and image links, tables required for most scraping operations like scraping an e-commerce website. Use this library to turn any webpage/url to LLM friendly text. Fully open source alternative to firecrawl and jina reader api. You can also refer to my other repo AI-web_scraper for direct scraping tools that will do web search and scrapes multiple links with just a simple query. It supports multiple LLMs, Web Search and…
Auszug aus dem README des Projekts auf GitHub.
Skills
Ein Open-Source-Projekt — erkunde den Code und hoste es selbst von GitHub aus.