Bỏ qua tới nội dung
TakoAPI
Quay lại kỹ năng

search-cluster

bởi 1999azzar

Search & Research
879Lượt tải do clawskills.sh công bố
0Lượt xem
0 lượt thíchĐăng nhập để thích kỹ năng này
—Chưa có đánh giá
Đánh giá của bạn

Tóm tắt

Unified search aggregator for Google, Wikipedia, Reddit, NewsAPI, and RSS feeds with optional Redis caching.

Mô tả

Kỹ năng này làm gì

Multi-provider search aggregator that queries Google CSE, Wikipedia, Reddit, GNews RSS, and DuckDuckGo (via headless scraping) in a single call. Returns structured JSON with source, title, link, and sanitized snippet per result. Supports optional Redis caching and runs the scraping provider in a subprocess-isolated virtual environment.

Querying five independent providers in one call reduces coverage gaps that occur when any single source is rate-limited, blocked, or returns poor results.

Khi nào nên dùng

  • Aggregating news and forum discussion results on a single topic across five sources
  • Cross-referencing Wikipedia summaries with Reddit threads during research
  • Building a search backend with automatic provider-level fallback
  • Fetching DuckDuckGo results without triggering bot detection
  • Caching repeated search queries to reduce API call volume

Quy trình ví dụ

ĐẦU VÀO

User asks: "Find recent news and discussions about LLM fine-tuning"

AGENT
  1. 1

    Invokes scripts/search-cluster.py with provider flag 'all' and the query string

  2. 2

    Dispatches requests to Google CSE, Wikipedia, Reddit, and GNews RSS concurrently

  3. 3

    Spawns an isolated subprocess running stealth_fetch.py to query DuckDuckGo via Scrapling

  4. 4

    Sanitizes and normalizes all provider responses into a shared schema

  5. 5

    Writes aggregated results to Redis cache if REDIS_HOST is configured

ĐẦU RA

Structured JSON array where each entry contains source, title, link, and sanitized snippet

Yêu cầu

  • GOOGLE_API_KEY (optional, Google Custom Search)
  • GOOGLE_CSE_ID (optional, Google Custom Search Engine ID)
  • SCRAPLING_PYTHON_PATH (optional, path to scrapling venv python binary)
  • REDIS_HOST and REDIS_PORT (optional, for result caching)

Cài đặt

clawhub install 1999azzar/search-cluster

Chạy lệnh CLI, hoặc dán prompt vào Claude Code, Cursor, Codex hay coding agent bạn đang dùng.

Liên kết