Pular para o conteúdo
TakoAPI
Voltar às skills

astrai-inference-router

por beee003

AI & LLMs
473Downloads informados pelo clawskills.sh
2Estrelas
0Visualizações
0 curtidaEntre para curtir esta skill
—Ainda sem avaliações
Sua avaliação

Resumo

Route all LLM calls through Astrai for 40%+ cost savings with intelligent routing and privacy controls.

Descrição

O que esta skill faz

Routes outgoing LLM API calls through Astrai's gateway, which classifies each task and selects the cheapest provider meeting a quality threshold. PII is stripped locally before prompts leave your machine in enhanced and max privacy modes. EU-only routing is available for GDPR compliance.

Combines cost routing, provider failover, and PII controls in one gateway without requiring changes to existing API call code.

Quando usá-la

  • Reducing daily API spend when running multiple LLM-powered agents
  • Keeping prompts within EU infrastructure to meet GDPR requirements
  • Capping daily LLM spend to prevent unexpected billing overruns
  • Automatically recovering when a provider goes down mid-session
  • Stripping names and emails from prompts before they reach any external model

Exemplo de fluxo de trabalho

ENTRADA

User asks: route my LLM calls through Astrai with EU-only mode and a $5 daily budget

AGENTE
  1. 1

    Reads ASTRAI_API_KEY from environment

  2. 2

    Sets REGION=eu and DAILY_BUDGET=5 in skill config

  3. 3

    Intercepts the outgoing LLM API call and forwards it to the Astrai gateway

  4. 4

    Astrai classifies the task type and selects the optimal EU-based provider

  5. 5

    Returns the response with per-request cost and savings data

SAÍDA

LLM response delivered via an EU provider with PII stripped and real-time cost savings reported

Requisitos

  • ASTRAI_API_KEY: free account at as-trai.com
  • ANTHROPIC_API_KEY: Anthropic API key
  • Astrai Pro plan ($49/mo) for EU routing and PII stripping; free tier limited to 1,000 requests/day with smart routing and failover only

Instalação

clawhub install beee003/astrai-inference-router

Execute o comando da CLI ou cole o prompt no Claude Code, Cursor, Codex ou no agente de código que você usa.

Links