본문으로 건너뛰기
TakoAPI
스킬로 돌아가기

local-first-llm

joelnishanth 제작

Coding Agents & IDEs
318clawskills.sh가 보고한 다운로드 수
1스타
0조회수
좋아요 0개로그인하면 이 스킬에 좋아요를 누를 수 있습니다
—아직 평가 없음
내 평가

요약

Routes LLM requests to a local model (Ollama, LM Studio, llamafile) before falling back to cloud APIs.

설명

이 스킬이 하는 일

Routes LLM requests to a local model (Ollama, LM Studio, or llamafile) before falling back to cloud APIs. Routing decisions factor in data sensitivity, prompt complexity, and local provider availability. Token usage and cost savings are logged to a persistent dashboard.

Combines automatic routing logic with cost tracking, so users get privacy and savings benefits without manually deciding which model to use each time.

사용 시점

  • Keeping sensitive prompts off cloud APIs
  • Reducing OpenAI API costs on repetitive tasks
  • Summarizing meeting transcripts with a local model
  • Checking how much money local routing has saved this month
  • Automatically routing complex queries to cloud while simple ones stay local

예시 워크플로

입력

User asks: summarize this meeting transcript and keep it private

에이전트
  1. 1

    Run check_local.py to detect available local providers

  2. 2

    Run route_request.py with the prompt and token estimate; sensitivity check routes to local

  3. 3

    Send the prompt to Ollama via its local API endpoint

  4. 4

    Run track_savings.py log to record the token count and routing decision

  5. 5

    Run dashboard.py to display updated cumulative savings

출력

Meeting transcript summarized locally; dashboard shows 800 tokens saved and cost avoidance logged

요구 사항

  • Ollama, LM Studio, or llamafile installed and running locally

설치

clawhub install joelnishanth/local-first-llm

CLI 명령을 실행하거나, 프롬프트를 Claude Code, Cursor, Codex 등 사용하는 코딩 에이전트에 붙여넣으세요.

링크