jetson-cuda-voice
بواسطة nikil511
DevOps & Cloudموجز
Fully offline, CUDA-accelerated local voice assistant pipeline for NVIDIA Jetson.
الوصف
ما الذي تفعله هذه المهارة
Offline voice assistant pipeline for NVIDIA Jetson devices. Chains wake word detection, voice activity detection, GPU-accelerated speech-to-text, LLM inference, and neural TTS. Only the LLM call requires internet access.
Running STT and TTS fully on-device eliminates round-trip latency and keeps audio data off third-party servers, which cloud-dependent pipelines cannot offer.
متى تستخدمها
- Hands-free home automation control on a Jetson-based device
- Private voice queries without sending audio to cloud STT services
- Multilingual voice assistant that auto-detects spoken language
- Always-on desk assistant with LED visual state feedback
- Embedded voice interface for robotics or kiosk projects
مثال على سير العمل
User says 'Hey Jarvis, what's the weather like today?'
- 1
openWakeWord detects the wake phrase and triggers a two-tone beep with blue LED
- 2
_measure_ambient() samples 480ms of room noise to set dynamic VAD thresholds
- 3
transcribe_stream() captures speech via VAD, sends audio to whisper.cpp CUDA server, returns transcript
- 4
ask_llm() sends transcript plus 20-turn conversation history to OpenRouter API and receives response
- 5
Piper TTS synthesizes the response offline and aplay outputs it while LED shows cyan then off
Spoken answer played through ALSA speaker, LEDs return to off state
المتطلبات
- OPENROUTER_API_KEY environment variable
- OpenRouter account (or self-hosted OpenAI-compatible LLM endpoint)
- NVIDIA Jetson device with JetPack installed
- ReSpeaker USB Mic Array v1.0 or compatible ALSA mic
التثبيت
clawhub install nikil511/jetson-cuda-voiceشغّل أمر واجهة سطر الأوامر، أو الصق النص في Claude Code أو Cursor أو Codex أو أي وكيل برمجة تستخدمه.