modelready
بواسطة carol-gutianle
AI & LLMsموجز
Start using a local or Hugging Face model instantly, directly from chat.
الوصف
ما الذي تفعله هذه المهارة
ModelReady starts a local or Hugging Face model as an OpenAI-compatible server and lets you chat with it without leaving your conversation. It uses vLLM to serve the model on a port you specify.
Eliminates switching to a terminal to launch vLLM, track the process, and manually curl the endpoint just to send a message.
متى تستخدمها
- Testing a freshly downloaded Hugging Face model checkpoint
- Chatting with a local Qwen or LLaMA model mid-session
- Running a fine-tuned model on a specific port for a quick demo
- Checking whether a model server is still up during a long session
- Switching between two local models by starting them on different ports
مثال على سير العمل
User asks: start Qwen2.5-7B-Instruct on port 19001 and send it a greeting
- 1
Run /modelready start repo=Qwen/Qwen2.5-7B-Instruct port=19001
- 2
Wait for the vLLM server to initialize and confirm it is ready
- 3
Run /modelready chat port=19001 text="hello"
- 4
Return the model response inline in the conversation
The model's reply to "hello" displayed in chat
المتطلبات
- vLLM installed on the host machine
- URL environment variable set to the server host address
التثبيت
clawhub install carol-gutianle/modelreadyشغّل أمر واجهة سطر الأوامر، أو الصق النص في Claude Code أو Cursor أو Codex أو أي وكيل برمجة تستخدمه.