Bỏ qua tới nội dung
TakoAPI
Quay lại kỹ năng

ramalama-cli

bởi ieaves

Health & Fitness
327Lượt tải do clawskills.sh công bố
0Lượt xem
0 lượt thíchĐăng nhập để thích kỹ năng này
—Chưa có đánh giá
Đánh giá của bạn

Tóm tắt

Run and interact with AI agents.

Mô tả

Kỹ năng này làm gì

ramalama runs AI models locally inside containers using Docker or Podman. It supports multiple model sources including HuggingFace, OCI registries, and direct URLs. Models can be run one-shot, served as an OpenAI-compatible endpoint, or queried with RAG context from local files.

Containerized execution via Docker or Podman gives full network and device isolation, which cloud-hosted inference APIs cannot provide.

Khi nào nên dùng

  • Run inference on sensitive documents without sending data to external APIs
  • Serve a local OpenAI-compatible endpoint for development and testing
  • Build a RAG knowledge bundle from internal docs and query it with a local model
  • Benchmark model quality and performance before integrating into a pipeline
  • Pull and test a specific HuggingFace model variant without a cloud account

Quy trình ví dụ

ĐẦU VÀO

User asks: summarize our internal auth docs using a local model

AGENT
  1. 1

    Run preflight: ramalama version and verify Docker or Podman is available

  2. 2

    Package local docs into a RAG bundle: ramalama rag ./docs auth-rag

  3. 3

    Run one-shot inference with RAG context: ramalama run --rag auth-rag granite3.3:2b "Summarize the auth requirements"

  4. 4

    Parse the text output and return the summary

ĐẦU RA

A concise summary of the auth requirements drawn from the local documentation

Yêu cầu

  • Docker or Podman installed and running

Cài đặt

clawhub install ieaves/ramalama-cli

Chạy lệnh CLI, hoặc dán prompt vào Claude Code, Cursor, Codex hay coding agent bạn đang dùng.

Liên kết