본문으로 건너뛰기
TakoAPI
스킬로 돌아가기

search-cluster

1999azzar 제작

Search & Research
879clawskills.sh가 보고한 다운로드 수
0조회수
좋아요 0개로그인하면 이 스킬에 좋아요를 누를 수 있습니다
—아직 평가 없음
내 평가

요약

Unified search aggregator for Google, Wikipedia, Reddit, NewsAPI, and RSS feeds with optional Redis caching.

설명

이 스킬이 하는 일

Multi-provider search aggregator that queries Google CSE, Wikipedia, Reddit, GNews RSS, and DuckDuckGo (via headless scraping) in a single call. Returns structured JSON with source, title, link, and sanitized snippet per result. Supports optional Redis caching and runs the scraping provider in a subprocess-isolated virtual environment.

Querying five independent providers in one call reduces coverage gaps that occur when any single source is rate-limited, blocked, or returns poor results.

사용 시점

  • Aggregating news and forum discussion results on a single topic across five sources
  • Cross-referencing Wikipedia summaries with Reddit threads during research
  • Building a search backend with automatic provider-level fallback
  • Fetching DuckDuckGo results without triggering bot detection
  • Caching repeated search queries to reduce API call volume

예시 워크플로

입력

User asks: "Find recent news and discussions about LLM fine-tuning"

에이전트
  1. 1

    Invokes scripts/search-cluster.py with provider flag 'all' and the query string

  2. 2

    Dispatches requests to Google CSE, Wikipedia, Reddit, and GNews RSS concurrently

  3. 3

    Spawns an isolated subprocess running stealth_fetch.py to query DuckDuckGo via Scrapling

  4. 4

    Sanitizes and normalizes all provider responses into a shared schema

  5. 5

    Writes aggregated results to Redis cache if REDIS_HOST is configured

출력

Structured JSON array where each entry contains source, title, link, and sanitized snippet

요구 사항

  • GOOGLE_API_KEY (optional, Google Custom Search)
  • GOOGLE_CSE_ID (optional, Google Custom Search Engine ID)
  • SCRAPLING_PYTHON_PATH (optional, path to scrapling venv python binary)
  • REDIS_HOST and REDIS_PORT (optional, for result caching)

설치

clawhub install 1999azzar/search-cluster

CLI 명령을 실행하거나, 프롬프트를 Claude Code, Cursor, Codex 등 사용하는 코딩 에이전트에 붙여넣으세요.

링크