jetson-cuda-voice
nikil511 द्वारा
DevOps & Cloudसंक्षिप्त
Fully offline, CUDA-accelerated local voice assistant pipeline for NVIDIA Jetson.
विवरण
यह स्किल क्या करती है
Offline voice assistant pipeline for NVIDIA Jetson devices. Chains wake word detection, voice activity detection, GPU-accelerated speech-to-text, LLM inference, and neural TTS. Only the LLM call requires internet access.
Running STT and TTS fully on-device eliminates round-trip latency and keeps audio data off third-party servers, which cloud-dependent pipelines cannot offer.
इसे कब इस्तेमाल करें
- Hands-free home automation control on a Jetson-based device
- Private voice queries without sending audio to cloud STT services
- Multilingual voice assistant that auto-detects spoken language
- Always-on desk assistant with LED visual state feedback
- Embedded voice interface for robotics or kiosk projects
उदाहरण वर्कफ़्लो
User says 'Hey Jarvis, what's the weather like today?'
- 1
openWakeWord detects the wake phrase and triggers a two-tone beep with blue LED
- 2
_measure_ambient() samples 480ms of room noise to set dynamic VAD thresholds
- 3
transcribe_stream() captures speech via VAD, sends audio to whisper.cpp CUDA server, returns transcript
- 4
ask_llm() sends transcript plus 20-turn conversation history to OpenRouter API and receives response
- 5
Piper TTS synthesizes the response offline and aplay outputs it while LED shows cyan then off
Spoken answer played through ALSA speaker, LEDs return to off state
आवश्यकताएँ
- OPENROUTER_API_KEY environment variable
- OpenRouter account (or self-hosted OpenAI-compatible LLM endpoint)
- NVIDIA Jetson device with JetPack installed
- ReSpeaker USB Mic Array v1.0 or compatible ALSA mic
इंस्टॉलेशन
clawhub install nikil511/jetson-cuda-voiceCLI कमांड चलाएँ, या प्रॉम्प्ट को Claude Code, Cursor, Codex या जो भी कोडिंग एजेंट आप इस्तेमाल करते हैं उसमें पेस्ट करें।