gradient-inference
simondelorean 제작
DevOps & Cloud요약
Community skill (unofficial) for DigitalOcean Gradient AI Serverless Inference.
설명
이 스킬이 하는 일
Connects to DigitalOcean's Gradient AI Serverless Inference API to run chat completions, generate images, and look up available models and pricing. The endpoint is OpenAI-compatible. Prompt caching is available via the Responses API to reduce costs on repeated context.
Because the endpoint is OpenAI-compatible, existing SDK code works with only a base URL change, and prompt caching via the Responses API reduces spend on follow-up queries that reuse the same context.
사용 시점
- Running LLM queries without managing GPU servers
- Checking model pricing before committing to a workload
- Generating images from text prompts via serverless API
- Using prompt caching to cut costs on repeated context
- Browsing and filtering available models before hardcoding an ID
예시 워크플로
User asks: summarize this earnings report and compare it to last quarter
- 1
Run gradient_pricing.py to check model costs before choosing
- 2
Select a model based on context length and cost requirements
- 3
Send the earnings report via the Responses API with store: true to cache the context
- 4
Send the follow-up comparison query, reusing the cached context
Summary of the earnings report, then a cost-efficient comparison to last quarter with shared context billed only once due to prompt caching
요구 사항
- GRADIENT_API_KEY environment variable (DigitalOcean Model Access Key from cloud.digitalocean.com)
- DigitalOcean account
설치
clawhub install simondelorean/gradient-inferenceCLI 명령을 실행하거나, 프롬프트를 Claude Code, Cursor, Codex 등 사용하는 코딩 에이전트에 붙여넣으세요.