跳到正文
TakoAPI
返回技能列表

astrai-inference-router

由 beee003 提供

AI & LLMs
473下载量由 clawskills.sh 提供
2星标
0浏览量
0 个赞登录后即可为这个技能点赞
—暂无评分
你的评分

简介

Route all LLM calls through Astrai for 40%+ cost savings with intelligent routing and privacy controls.

描述

该技能的功能

Routes outgoing LLM API calls through Astrai's gateway, which classifies each task and selects the cheapest provider meeting a quality threshold. PII is stripped locally before prompts leave your machine in enhanced and max privacy modes. EU-only routing is available for GDPR compliance.

Combines cost routing, provider failover, and PII controls in one gateway without requiring changes to existing API call code.

何时使用

  • Reducing daily API spend when running multiple LLM-powered agents
  • Keeping prompts within EU infrastructure to meet GDPR requirements
  • Capping daily LLM spend to prevent unexpected billing overruns
  • Automatically recovering when a provider goes down mid-session
  • Stripping names and emails from prompts before they reach any external model

示例工作流

输入

User asks: route my LLM calls through Astrai with EU-only mode and a $5 daily budget

智能体
  1. 1

    Reads ASTRAI_API_KEY from environment

  2. 2

    Sets REGION=eu and DAILY_BUDGET=5 in skill config

  3. 3

    Intercepts the outgoing LLM API call and forwards it to the Astrai gateway

  4. 4

    Astrai classifies the task type and selects the optimal EU-based provider

  5. 5

    Returns the response with per-request cost and savings data

输出

LLM response delivered via an EU provider with PII stripped and real-time cost savings reported

前置要求

  • ASTRAI_API_KEY: free account at as-trai.com
  • ANTHROPIC_API_KEY: Anthropic API key
  • Astrai Pro plan ($49/mo) for EU routing and PII stripping; free tier limited to 1,000 requests/day with smart routing and failover only

安装

clawhub install beee003/astrai-inference-router

运行 CLI 命令,或把这段提示词粘贴到 Claude Code、Cursor、Codex 或你在用的任意编程智能体里。

链接