gradient-inference
por simondelorean
DevOps & CloudResumo
Community skill (unofficial) for DigitalOcean Gradient AI Serverless Inference.
Descrição
O que esta skill faz
Connects to DigitalOcean's Gradient AI Serverless Inference API to run chat completions, generate images, and look up available models and pricing. The endpoint is OpenAI-compatible. Prompt caching is available via the Responses API to reduce costs on repeated context.
Because the endpoint is OpenAI-compatible, existing SDK code works with only a base URL change, and prompt caching via the Responses API reduces spend on follow-up queries that reuse the same context.
Quando usá-la
- Running LLM queries without managing GPU servers
- Checking model pricing before committing to a workload
- Generating images from text prompts via serverless API
- Using prompt caching to cut costs on repeated context
- Browsing and filtering available models before hardcoding an ID
Exemplo de fluxo de trabalho
User asks: summarize this earnings report and compare it to last quarter
- 1
Run gradient_pricing.py to check model costs before choosing
- 2
Select a model based on context length and cost requirements
- 3
Send the earnings report via the Responses API with store: true to cache the context
- 4
Send the follow-up comparison query, reusing the cached context
Summary of the earnings report, then a cost-efficient comparison to last quarter with shared context billed only once due to prompt caching
Requisitos
- GRADIENT_API_KEY environment variable (DigitalOcean Model Access Key from cloud.digitalocean.com)
- DigitalOcean account
Instalação
clawhub install simondelorean/gradient-inferenceExecute o comando da CLI ou cole o prompt no Claude Code, Cursor, Codex ou no agente de código que você usa.