jetson-cuda-voice
bởi nikil511
DevOps & CloudTóm tắt
Fully offline, CUDA-accelerated local voice assistant pipeline for NVIDIA Jetson.
Mô tả
Kỹ năng này làm gì
Offline voice assistant pipeline for NVIDIA Jetson devices. Chains wake word detection, voice activity detection, GPU-accelerated speech-to-text, LLM inference, and neural TTS. Only the LLM call requires internet access.
Running STT and TTS fully on-device eliminates round-trip latency and keeps audio data off third-party servers, which cloud-dependent pipelines cannot offer.
Khi nào nên dùng
- Hands-free home automation control on a Jetson-based device
- Private voice queries without sending audio to cloud STT services
- Multilingual voice assistant that auto-detects spoken language
- Always-on desk assistant with LED visual state feedback
- Embedded voice interface for robotics or kiosk projects
Quy trình ví dụ
User says 'Hey Jarvis, what's the weather like today?'
- 1
openWakeWord detects the wake phrase and triggers a two-tone beep with blue LED
- 2
_measure_ambient() samples 480ms of room noise to set dynamic VAD thresholds
- 3
transcribe_stream() captures speech via VAD, sends audio to whisper.cpp CUDA server, returns transcript
- 4
ask_llm() sends transcript plus 20-turn conversation history to OpenRouter API and receives response
- 5
Piper TTS synthesizes the response offline and aplay outputs it while LED shows cyan then off
Spoken answer played through ALSA speaker, LEDs return to off state
Yêu cầu
- OPENROUTER_API_KEY environment variable
- OpenRouter account (or self-hosted OpenAI-compatible LLM endpoint)
- NVIDIA Jetson device with JetPack installed
- ReSpeaker USB Mic Array v1.0 or compatible ALSA mic
Cài đặt
clawhub install nikil511/jetson-cuda-voiceChạy lệnh CLI, hoặc dán prompt vào Claude Code, Cursor, Codex hay coding agent bạn đang dùng.