Bỏ qua tới nội dung
TakoAPI
Quay lại kỹ năng

litellm

bởi ishaan-jaff

Coding Agents & IDEs
1.3kLượt tải do clawskills.sh công bố
1Sao
0Lượt xem
0 lượt thíchĐăng nhập để thích kỹ năng này
—Chưa có đánh giá
Đánh giá của bạn

Tóm tắt

Call 100+ LLM providers through LiteLLM's unified API.

Mô tả

Kỹ năng này làm gì

LiteLLM provides a unified Python API to call 100+ LLM providers using the same interface. It handles routing, so you can switch between OpenAI, Anthropic, Google, and others without rewriting call logic. A proxy mode adds caching, rate limiting, and observability on top.

Instead of maintaining separate SDK integrations for each provider, one call signature works across all of them.

Khi nào nên dùng

  • Route code review tasks to GPT-4o while running on Claude
  • Compare outputs from three models on the same prompt
  • Switch to gpt-4o-mini for simple classification to cut costs
  • Access Gemini or Mistral from a runtime that only supports OpenAI format
  • Point all LLM calls through a shared proxy for usage tracking

Quy trình ví dụ

ĐẦU VÀO

User asks: compare how GPT-4o and Claude answer 'What is the best sorting algorithm?'

AGENT
  1. 1

    Import litellm and define the prompt as a messages list

  2. 2

    Loop over ["gpt-4o", "claude-sonnet-4-20250514"]

  3. 3

    Call litellm.completion(model=model, messages=prompt) for each

  4. 4

    Extract response.choices[0].message.content from each result

  5. 5

    Print each model name alongside its response

ĐẦU RA

Side-by-side text outputs from GPT-4o and Claude for the same question

Yêu cầu

  • OPENAI_API_KEY environment variable (for OpenAI models)
  • ANTHROPIC_API_KEY environment variable (for Anthropic models)

Cài đặt

clawhub install ishaan-jaff/litellm

Chạy lệnh CLI, hoặc dán prompt vào Claude Code, Cursor, Codex hay coding agent bạn đang dùng.

Liên kết