Bỏ qua tới nội dung
TakoAPI
Quay lại kỹ năng

kalibr

bởi devonakelley

Transportation
—Chưa có đánh giá
Đánh giá của bạn

Tóm tắt

Ship agents that fix themselves.

Mô tả

Kỹ năng này làm gì

Kalibr routes AI agent execution paths based on real production telemetry. You define candidate paths (model + tools + parameters) and it learns which performs best for each task, shifting traffic away from failures or degraded providers automatically. Uses Thompson Sampling with 10% canary traffic to catch degradation before users notice.

Unlike LiteLLM or LangChain fallbacks that react to failures after the fact, Kalibr routes proactively based on learned success rates per task, so a degraded provider is avoided before a request is lost.

Khi nào nên dùng

  • Automatic failover when OpenAI or Anthropic has an outage
  • Routing different agent tasks to different models based on past success rates
  • Reducing LLM costs without manually tuning model selection
  • Detecting when a model starts returning worse results over time
  • Replacing a hardcoded model name with adaptive path selection

Quy trình ví dụ

ĐẦU VÀO

User asks: Route my email extraction agent across GPT-4o, Claude, and Gemini and adapt based on what works

AGENT
  1. 1

    Import Router from kalibr and define three candidate paths with different models and parameters

  2. 2

    Call router.completion() with the user message, which Kalibr routes to the current best path

  3. 3

    Evaluate the response and call router.report(success=True/False) or use success_when= for auto-reporting

  4. 4

    Kalibr updates internal telemetry and adjusts path weights after each outcome

  5. 5

    After ~50 outcomes, routing is locked in and continuously adapting via canary traffic

ĐẦU RA

Agent calls automatically route to the highest-performing model path, with degraded paths deprioritized without manual intervention

Yêu cầu

  • KALIBR_API_KEY environment variable
  • KALIBR_TENANT_ID environment variable
  • Kalibr account at https://dashboard.kalibr.systems/settings

Cài đặt

clawhub install devonakelley/kalibr

Chạy lệnh CLI, hoặc dán prompt vào Claude Code, Cursor, Codex hay coding agent bạn đang dùng.

Liên kết