Skip to content
TakoAPI
Back to skills

litellm

by ishaan-jaff

Coding Agents & IDEs
1.3kDownloads reported by clawskills.sh
1Stars
0Views
0 likesSign in to like this skill
—Not yet rated
Your rating

Brief

Call 100+ LLM providers through LiteLLM's unified API.

Description

What This Skill Does

LiteLLM provides a unified Python API to call 100+ LLM providers using the same interface. It handles routing, so you can switch between OpenAI, Anthropic, Google, and others without rewriting call logic. A proxy mode adds caching, rate limiting, and observability on top.

Instead of maintaining separate SDK integrations for each provider, one call signature works across all of them.

When to Use It

  • Route code review tasks to GPT-4o while running on Claude
  • Compare outputs from three models on the same prompt
  • Switch to gpt-4o-mini for simple classification to cut costs
  • Access Gemini or Mistral from a runtime that only supports OpenAI format
  • Point all LLM calls through a shared proxy for usage tracking

Example Workflow

INPUT

User asks: compare how GPT-4o and Claude answer 'What is the best sorting algorithm?'

AGENT
  1. 1

    Import litellm and define the prompt as a messages list

  2. 2

    Loop over ["gpt-4o", "claude-sonnet-4-20250514"]

  3. 3

    Call litellm.completion(model=model, messages=prompt) for each

  4. 4

    Extract response.choices[0].message.content from each result

  5. 5

    Print each model name alongside its response

OUTPUT

Side-by-side text outputs from GPT-4o and Claude for the same question

Requirements

  • OPENAI_API_KEY environment variable (for OpenAI models)
  • ANTHROPIC_API_KEY environment variable (for Anthropic models)

Installation

clawhub install ishaan-jaff/litellm

Run the CLI command, or paste the prompt into Claude Code, Cursor, Codex or whichever coding agent you use.

Links