communicate
kenblive tarafından
AI & LLMsÖzet
Start using a local or Hugging Face model instantly, directly from chat.
Açıklama
Bu Beceri Ne Yapar
ModelReady starts a local or Hugging Face model as an OpenAI-compatible endpoint and lets you chat with it directly from a conversation. It handles server startup, status checks, and teardown without switching tools.
It removes the manual steps of configuring vLLM, managing endpoints, and opening a separate chat interface.
Ne Zaman Kullanılır
- Testing a newly downloaded Hugging Face model without writing server code
- Running a quantized local LLM on a specific port during development
- Chatting with a self-hosted model from the terminal
- Switching between multiple model servers by port
- Exposing a local model to other tools via OpenAI-compatible API
Örnek İş Akışı
User asks: start Qwen2.5-7B on port 8010 and send it a test message
- 1
Run /modelready start repo=Qwen/Qwen2.5-7B-Instruct port=8010
- 2
Poll /modelready status port=8010 until the server reports ready
- 3
Run /modelready chat port=8010 text="hello"
- 4
Return the model response to the user
The locally running Qwen2.5-7B instance replies to the greeting
Gereksinimler
- URL environment variable set to the target host address
Kurulum
clawhub install kenblive/communicateCLI komutunu çalıştırın ya da istemi Claude Code, Cursor, Codex veya kullandığınız kodlama ajanına yapıştırın.