communicate
от kenblive
AI & LLMsКратко
Start using a local or Hugging Face model instantly, directly from chat.
Описание
Что делает этот навык
ModelReady starts a local or Hugging Face model as an OpenAI-compatible endpoint and lets you chat with it directly from a conversation. It handles server startup, status checks, and teardown without switching tools.
It removes the manual steps of configuring vLLM, managing endpoints, and opening a separate chat interface.
Когда его использовать
- Testing a newly downloaded Hugging Face model without writing server code
- Running a quantized local LLM on a specific port during development
- Chatting with a self-hosted model from the terminal
- Switching between multiple model servers by port
- Exposing a local model to other tools via OpenAI-compatible API
Пример сценария
User asks: start Qwen2.5-7B on port 8010 and send it a test message
- 1
Run /modelready start repo=Qwen/Qwen2.5-7B-Instruct port=8010
- 2
Poll /modelready status port=8010 until the server reports ready
- 3
Run /modelready chat port=8010 text="hello"
- 4
Return the model response to the user
The locally running Qwen2.5-7B instance replies to the greeting
Требования
- URL environment variable set to the target host address
Установка
clawhub install kenblive/communicateВыполните команду CLI или вставьте промпт в Claude Code, Cursor, Codex — любой кодинг-агент, которым пользуетесь.