跳到正文
TakoAPI
返回技能列表

search-cluster

由 1999azzar 提供

Search & Research
879下载量由 clawskills.sh 提供
0浏览量
0 个赞登录后即可为这个技能点赞
—暂无评分
你的评分

简介

Unified search aggregator for Google, Wikipedia, Reddit, NewsAPI, and RSS feeds with optional Redis caching.

描述

该技能的功能

Multi-provider search aggregator that queries Google CSE, Wikipedia, Reddit, GNews RSS, and DuckDuckGo (via headless scraping) in a single call. Returns structured JSON with source, title, link, and sanitized snippet per result. Supports optional Redis caching and runs the scraping provider in a subprocess-isolated virtual environment.

Querying five independent providers in one call reduces coverage gaps that occur when any single source is rate-limited, blocked, or returns poor results.

何时使用

  • Aggregating news and forum discussion results on a single topic across five sources
  • Cross-referencing Wikipedia summaries with Reddit threads during research
  • Building a search backend with automatic provider-level fallback
  • Fetching DuckDuckGo results without triggering bot detection
  • Caching repeated search queries to reduce API call volume

示例工作流

输入

User asks: "Find recent news and discussions about LLM fine-tuning"

智能体
  1. 1

    Invokes scripts/search-cluster.py with provider flag 'all' and the query string

  2. 2

    Dispatches requests to Google CSE, Wikipedia, Reddit, and GNews RSS concurrently

  3. 3

    Spawns an isolated subprocess running stealth_fetch.py to query DuckDuckGo via Scrapling

  4. 4

    Sanitizes and normalizes all provider responses into a shared schema

  5. 5

    Writes aggregated results to Redis cache if REDIS_HOST is configured

输出

Structured JSON array where each entry contains source, title, link, and sanitized snippet

前置要求

  • GOOGLE_API_KEY (optional, Google Custom Search)
  • GOOGLE_CSE_ID (optional, Google Custom Search Engine ID)
  • SCRAPLING_PYTHON_PATH (optional, path to scrapling venv python binary)
  • REDIS_HOST and REDIS_PORT (optional, for result caching)

安装

clawhub install 1999azzar/search-cluster

运行 CLI 命令,或把这段提示词粘贴到 Claude Code、Cursor、Codex 或你在用的任意编程智能体里。

链接