कंटेंट पर जाएँ
TakoAPI
स्किल्स पर वापस

llmfit

alexsjones द्वारा

AI & LLMs
516clawskills.sh द्वारा बताए गए डाउनलोड
1व्यूज़
0 लाइकइस स्किल को लाइक करने के लिए साइन इन करें
—अभी तक कोई रेटिंग नहीं
आपकी रेटिंग

संक्षिप्त

Detect local hardware (RAM, CPU, GPU/VRAM) and recommend the best-fit local LLM models with optimal quantization.

विवरण

यह स्किल क्या करती है

Detects local hardware (CPU, RAM, GPU/VRAM) and ranks LLM models by how well they fit, with optimal quantization settings and estimated tokens-per-second. Each recommendation includes a composite score broken down by quality, speed, fit, and context length. Supports configuration for Ollama, vLLM, and LM Studio.

Instead of downloading a model and discovering it exceeds your VRAM at runtime, llmfit reads your actual hardware and scores candidates before you pull anything.

इसे कब इस्तेमाल करें

  • Checking which models fit your GPU before downloading from Ollama
  • Finding the best coding model for a specific machine
  • Confirming whether a large model like Llama 70B will run locally
  • Choosing quantization level to maximize quality within VRAM limits
  • Configuring LM Studio with hardware-matched model recommendations

उदाहरण वर्कफ़्लो

इनपुट

User asks: what local models can I run?

एजेंट
  1. 1

    Run llmfit --json system to detect CPU, RAM, GPU name, and VRAM

  2. 2

    Run llmfit recommend --json --limit 5 to get top-scored models for the detected hardware

  3. 3

    Present each recommendation with fit level, best quantization, and estimated tokens/sec

  4. 4

    Map the chosen model's HuggingFace ID to its Ollama tag

  5. 5

    Update openclaw.json with the selected model and optionally set it as default

आउटपुट

Top 5 hardware-matched model recommendations with fit levels and quantization settings, plus an updated openclaw.json configuration

आवश्यकताएँ

  • llmfit CLI — install via `brew tap AlexsJones/llmfit && brew install llmfit` or `cargo install llmfit`

इंस्टॉलेशन

clawhub install alexsjones/llmfit

CLI कमांड चलाएँ, या प्रॉम्प्ट को Claude Code, Cursor, Codex या जो भी कोडिंग एजेंट आप इस्तेमाल करते हैं उसमें पेस्ट करें।

लिंक