Zum Inhalt springen
TakoAPI
Zurück zu den Skills

litellm

von ishaan-jaff

Coding Agents & IDEs
1.3kDownloadzahlen laut clawskills.sh
1Sterne
0Aufrufe
0 LikesMelde dich an, um diesen Skill zu liken
—Noch nicht bewertet
Deine Bewertung

Kurzbeschreibung

Call 100+ LLM providers through LiteLLM's unified API.

Beschreibung

Was dieser Skill macht

LiteLLM provides a unified Python API to call 100+ LLM providers using the same interface. It handles routing, so you can switch between OpenAI, Anthropic, Google, and others without rewriting call logic. A proxy mode adds caching, rate limiting, and observability on top.

Instead of maintaining separate SDK integrations for each provider, one call signature works across all of them.

Wann du ihn einsetzt

  • Route code review tasks to GPT-4o while running on Claude
  • Compare outputs from three models on the same prompt
  • Switch to gpt-4o-mini for simple classification to cut costs
  • Access Gemini or Mistral from a runtime that only supports OpenAI format
  • Point all LLM calls through a shared proxy for usage tracking

Beispiel-Workflow

EINGABE

User asks: compare how GPT-4o and Claude answer 'What is the best sorting algorithm?'

AGENT
  1. 1

    Import litellm and define the prompt as a messages list

  2. 2

    Loop over ["gpt-4o", "claude-sonnet-4-20250514"]

  3. 3

    Call litellm.completion(model=model, messages=prompt) for each

  4. 4

    Extract response.choices[0].message.content from each result

  5. 5

    Print each model name alongside its response

AUSGABE

Side-by-side text outputs from GPT-4o and Claude for the same question

Voraussetzungen

  • OPENAI_API_KEY environment variable (for OpenAI models)
  • ANTHROPIC_API_KEY environment variable (for Anthropic models)

Installation

clawhub install ishaan-jaff/litellm

Führe den CLI-Befehl aus oder füge den Prompt in Claude Code, Cursor, Codex oder deinen Coding-Agenten ein.

Links