Bỏ qua tới nội dung
TakoAPI
Quay lại kỹ năng

jetson-cuda-voice

bởi nikil511

DevOps & Cloud
314Lượt tải do clawskills.sh công bố
0Lượt xem
0 lượt thíchĐăng nhập để thích kỹ năng này
—Chưa có đánh giá
Đánh giá của bạn

Tóm tắt

Fully offline, CUDA-accelerated local voice assistant pipeline for NVIDIA Jetson.

Mô tả

Kỹ năng này làm gì

Offline voice assistant pipeline for NVIDIA Jetson devices. Chains wake word detection, voice activity detection, GPU-accelerated speech-to-text, LLM inference, and neural TTS. Only the LLM call requires internet access.

Running STT and TTS fully on-device eliminates round-trip latency and keeps audio data off third-party servers, which cloud-dependent pipelines cannot offer.

Khi nào nên dùng

  • Hands-free home automation control on a Jetson-based device
  • Private voice queries without sending audio to cloud STT services
  • Multilingual voice assistant that auto-detects spoken language
  • Always-on desk assistant with LED visual state feedback
  • Embedded voice interface for robotics or kiosk projects

Quy trình ví dụ

ĐẦU VÀO

User says 'Hey Jarvis, what's the weather like today?'

AGENT
  1. 1

    openWakeWord detects the wake phrase and triggers a two-tone beep with blue LED

  2. 2

    _measure_ambient() samples 480ms of room noise to set dynamic VAD thresholds

  3. 3

    transcribe_stream() captures speech via VAD, sends audio to whisper.cpp CUDA server, returns transcript

  4. 4

    ask_llm() sends transcript plus 20-turn conversation history to OpenRouter API and receives response

  5. 5

    Piper TTS synthesizes the response offline and aplay outputs it while LED shows cyan then off

ĐẦU RA

Spoken answer played through ALSA speaker, LEDs return to off state

Yêu cầu

  • OPENROUTER_API_KEY environment variable
  • OpenRouter account (or self-hosted OpenAI-compatible LLM endpoint)
  • NVIDIA Jetson device with JetPack installed
  • ReSpeaker USB Mic Array v1.0 or compatible ALSA mic

Cài đặt

clawhub install nikil511/jetson-cuda-voice

Chạy lệnh CLI, hoặc dán prompt vào Claude Code, Cursor, Codex hay coding agent bạn đang dùng.

Liên kết