कंटेंट पर जाएँ
TakoAPI
स्किल्स पर वापस
—अभी तक कोई रेटिंग नहीं
आपकी रेटिंग

संक्षिप्त

Start using a local or Hugging Face model instantly, directly from chat.

विवरण

यह स्किल क्या करती है

ModelReady starts a local or Hugging Face model as an OpenAI-compatible endpoint and lets you chat with it directly from a conversation. It handles server startup, status checks, and teardown without switching tools.

It removes the manual steps of configuring vLLM, managing endpoints, and opening a separate chat interface.

इसे कब इस्तेमाल करें

  • Testing a newly downloaded Hugging Face model without writing server code
  • Running a quantized local LLM on a specific port during development
  • Chatting with a self-hosted model from the terminal
  • Switching between multiple model servers by port
  • Exposing a local model to other tools via OpenAI-compatible API

उदाहरण वर्कफ़्लो

इनपुट

User asks: start Qwen2.5-7B on port 8010 and send it a test message

एजेंट
  1. 1

    Run /modelready start repo=Qwen/Qwen2.5-7B-Instruct port=8010

  2. 2

    Poll /modelready status port=8010 until the server reports ready

  3. 3

    Run /modelready chat port=8010 text="hello"

  4. 4

    Return the model response to the user

आउटपुट

The locally running Qwen2.5-7B instance replies to the greeting

आवश्यकताएँ

  • URL environment variable set to the target host address

इंस्टॉलेशन

clawhub install kenblive/communicate

CLI कमांड चलाएँ, या प्रॉम्प्ट को Claude Code, Cursor, Codex या जो भी कोडिंग एजेंट आप इस्तेमाल करते हैं उसमें पेस्ट करें।

लिंक