Bỏ qua tới nội dung
TakoAPI
Quay lại kỹ năng

astrai-inference-router

bởi beee003

AI & LLMs
473Lượt tải do clawskills.sh công bố
2Sao
0Lượt xem
0 lượt thíchĐăng nhập để thích kỹ năng này
—Chưa có đánh giá
Đánh giá của bạn

Tóm tắt

Route all LLM calls through Astrai for 40%+ cost savings with intelligent routing and privacy controls.

Mô tả

Kỹ năng này làm gì

Routes outgoing LLM API calls through Astrai's gateway, which classifies each task and selects the cheapest provider meeting a quality threshold. PII is stripped locally before prompts leave your machine in enhanced and max privacy modes. EU-only routing is available for GDPR compliance.

Combines cost routing, provider failover, and PII controls in one gateway without requiring changes to existing API call code.

Khi nào nên dùng

  • Reducing daily API spend when running multiple LLM-powered agents
  • Keeping prompts within EU infrastructure to meet GDPR requirements
  • Capping daily LLM spend to prevent unexpected billing overruns
  • Automatically recovering when a provider goes down mid-session
  • Stripping names and emails from prompts before they reach any external model

Quy trình ví dụ

ĐẦU VÀO

User asks: route my LLM calls through Astrai with EU-only mode and a $5 daily budget

AGENT
  1. 1

    Reads ASTRAI_API_KEY from environment

  2. 2

    Sets REGION=eu and DAILY_BUDGET=5 in skill config

  3. 3

    Intercepts the outgoing LLM API call and forwards it to the Astrai gateway

  4. 4

    Astrai classifies the task type and selects the optimal EU-based provider

  5. 5

    Returns the response with per-request cost and savings data

ĐẦU RA

LLM response delivered via an EU provider with PII stripped and real-time cost savings reported

Yêu cầu

  • ASTRAI_API_KEY: free account at as-trai.com
  • ANTHROPIC_API_KEY: Anthropic API key
  • Astrai Pro plan ($49/mo) for EU routing and PII stripping; free tier limited to 1,000 requests/day with smart routing and failover only

Cài đặt

clawhub install beee003/astrai-inference-router

Chạy lệnh CLI, hoặc dán prompt vào Claude Code, Cursor, Codex hay coding agent bạn đang dùng.

Liên kết