litellm
ishaan-jaff द्वारा
Coding Agents & IDEsसंक्षिप्त
Call 100+ LLM providers through LiteLLM's unified API.
विवरण
यह स्किल क्या करती है
LiteLLM provides a unified Python API to call 100+ LLM providers using the same interface. It handles routing, so you can switch between OpenAI, Anthropic, Google, and others without rewriting call logic. A proxy mode adds caching, rate limiting, and observability on top.
Instead of maintaining separate SDK integrations for each provider, one call signature works across all of them.
इसे कब इस्तेमाल करें
- Route code review tasks to GPT-4o while running on Claude
- Compare outputs from three models on the same prompt
- Switch to gpt-4o-mini for simple classification to cut costs
- Access Gemini or Mistral from a runtime that only supports OpenAI format
- Point all LLM calls through a shared proxy for usage tracking
उदाहरण वर्कफ़्लो
User asks: compare how GPT-4o and Claude answer 'What is the best sorting algorithm?'
- 1
Import litellm and define the prompt as a messages list
- 2
Loop over ["gpt-4o", "claude-sonnet-4-20250514"]
- 3
Call litellm.completion(model=model, messages=prompt) for each
- 4
Extract response.choices[0].message.content from each result
- 5
Print each model name alongside its response
Side-by-side text outputs from GPT-4o and Claude for the same question
आवश्यकताएँ
- OPENAI_API_KEY environment variable (for OpenAI models)
- ANTHROPIC_API_KEY environment variable (for Anthropic models)
इंस्टॉलेशन
clawhub install ishaan-jaff/litellmCLI कमांड चलाएँ, या प्रॉम्प्ट को Claude Code, Cursor, Codex या जो भी कोडिंग एजेंट आप इस्तेमाल करते हैं उसमें पेस्ट करें।