Lewati ke konten
TakoAPI
Kembali ke skill

search-cluster

oleh 1999azzar

Search & Research
879Unduhan dilaporkan oleh clawskills.sh
0Tayangan
0 sukaMasuk untuk menyukai skill ini
—Belum ada penilaian
Penilaian Anda

Ringkasan

Unified search aggregator for Google, Wikipedia, Reddit, NewsAPI, and RSS feeds with optional Redis caching.

Deskripsi

Apa yang Dilakukan Skill Ini

Multi-provider search aggregator that queries Google CSE, Wikipedia, Reddit, GNews RSS, and DuckDuckGo (via headless scraping) in a single call. Returns structured JSON with source, title, link, and sanitized snippet per result. Supports optional Redis caching and runs the scraping provider in a subprocess-isolated virtual environment.

Querying five independent providers in one call reduces coverage gaps that occur when any single source is rate-limited, blocked, or returns poor results.

Kapan Menggunakannya

  • Aggregating news and forum discussion results on a single topic across five sources
  • Cross-referencing Wikipedia summaries with Reddit threads during research
  • Building a search backend with automatic provider-level fallback
  • Fetching DuckDuckGo results without triggering bot detection
  • Caching repeated search queries to reduce API call volume

Contoh Alur Kerja

INPUT

User asks: "Find recent news and discussions about LLM fine-tuning"

AGENT
  1. 1

    Invokes scripts/search-cluster.py with provider flag 'all' and the query string

  2. 2

    Dispatches requests to Google CSE, Wikipedia, Reddit, and GNews RSS concurrently

  3. 3

    Spawns an isolated subprocess running stealth_fetch.py to query DuckDuckGo via Scrapling

  4. 4

    Sanitizes and normalizes all provider responses into a shared schema

  5. 5

    Writes aggregated results to Redis cache if REDIS_HOST is configured

OUTPUT

Structured JSON array where each entry contains source, title, link, and sanitized snippet

Persyaratan

  • GOOGLE_API_KEY (optional, Google Custom Search)
  • GOOGLE_CSE_ID (optional, Google Custom Search Engine ID)
  • SCRAPLING_PYTHON_PATH (optional, path to scrapling venv python binary)
  • REDIS_HOST and REDIS_PORT (optional, for result caching)

Instalasi

clawhub install 1999azzar/search-cluster

Jalankan perintah CLI-nya, atau tempel prompt ke Claude Code, Cursor, Codex, atau coding agent apa pun yang Anda pakai.

Tautan