astrai-inference-router
beee003 作
AI & LLMs概要
Route all LLM calls through Astrai for 40%+ cost savings with intelligent routing and privacy controls.
説明
このスキルでできること
Routes outgoing LLM API calls through Astrai's gateway, which classifies each task and selects the cheapest provider meeting a quality threshold. PII is stripped locally before prompts leave your machine in enhanced and max privacy modes. EU-only routing is available for GDPR compliance.
Combines cost routing, provider failover, and PII controls in one gateway without requiring changes to existing API call code.
使いどころ
- Reducing daily API spend when running multiple LLM-powered agents
- Keeping prompts within EU infrastructure to meet GDPR requirements
- Capping daily LLM spend to prevent unexpected billing overruns
- Automatically recovering when a provider goes down mid-session
- Stripping names and emails from prompts before they reach any external model
ワークフロー例
User asks: route my LLM calls through Astrai with EU-only mode and a $5 daily budget
- 1
Reads ASTRAI_API_KEY from environment
- 2
Sets REGION=eu and DAILY_BUDGET=5 in skill config
- 3
Intercepts the outgoing LLM API call and forwards it to the Astrai gateway
- 4
Astrai classifies the task type and selects the optimal EU-based provider
- 5
Returns the response with per-request cost and savings data
LLM response delivered via an EU provider with PII stripped and real-time cost savings reported
要件
- ASTRAI_API_KEY: free account at as-trai.com
- ANTHROPIC_API_KEY: Anthropic API key
- Astrai Pro plan ($49/mo) for EU routing and PII stripping; free tier limited to 1,000 requests/day with smart routing and failover only
インストール
clawhub install beee003/astrai-inference-routerCLIコマンドを実行するか、Claude Code、Cursor、Codexなどお使いのコーディングエージェントにプロンプトを貼り付けてください。