Bỏ qua tới nội dung
TakoAPI
Quay lại kỹ năng

gradient-inference

bởi simondelorean

DevOps & Cloud
478Lượt tải do clawskills.sh công bố
1Lượt xem
0 lượt thíchĐăng nhập để thích kỹ năng này
—Chưa có đánh giá
Đánh giá của bạn

Tóm tắt

Community skill (unofficial) for DigitalOcean Gradient AI Serverless Inference.

Mô tả

Kỹ năng này làm gì

Connects to DigitalOcean's Gradient AI Serverless Inference API to run chat completions, generate images, and look up available models and pricing. The endpoint is OpenAI-compatible. Prompt caching is available via the Responses API to reduce costs on repeated context.

Because the endpoint is OpenAI-compatible, existing SDK code works with only a base URL change, and prompt caching via the Responses API reduces spend on follow-up queries that reuse the same context.

Khi nào nên dùng

  • Running LLM queries without managing GPU servers
  • Checking model pricing before committing to a workload
  • Generating images from text prompts via serverless API
  • Using prompt caching to cut costs on repeated context
  • Browsing and filtering available models before hardcoding an ID

Quy trình ví dụ

ĐẦU VÀO

User asks: summarize this earnings report and compare it to last quarter

AGENT
  1. 1

    Run gradient_pricing.py to check model costs before choosing

  2. 2

    Select a model based on context length and cost requirements

  3. 3

    Send the earnings report via the Responses API with store: true to cache the context

  4. 4

    Send the follow-up comparison query, reusing the cached context

ĐẦU RA

Summary of the earnings report, then a cost-efficient comparison to last quarter with shared context billed only once due to prompt caching

Yêu cầu

  • GRADIENT_API_KEY environment variable (DigitalOcean Model Access Key from cloud.digitalocean.com)
  • DigitalOcean account

Cài đặt

clawhub install simondelorean/gradient-inference

Chạy lệnh CLI, hoặc dán prompt vào Claude Code, Cursor, Codex hay coding agent bạn đang dùng.

Liên kết