Vai al contenuto
TakoAPI
Torna alle skill

jetson-cuda-voice

di nikil511

DevOps & Cloud
314Download riportati da clawskills.sh
0Visualizzazioni
0 likeAccedi per mettere like a questa skill
—Non ancora valutato
La tua valutazione

Sintesi

Fully offline, CUDA-accelerated local voice assistant pipeline for NVIDIA Jetson.

Descrizione

Cosa fa questa skill

Offline voice assistant pipeline for NVIDIA Jetson devices. Chains wake word detection, voice activity detection, GPU-accelerated speech-to-text, LLM inference, and neural TTS. Only the LLM call requires internet access.

Running STT and TTS fully on-device eliminates round-trip latency and keeps audio data off third-party servers, which cloud-dependent pipelines cannot offer.

Quando usarla

  • Hands-free home automation control on a Jetson-based device
  • Private voice queries without sending audio to cloud STT services
  • Multilingual voice assistant that auto-detects spoken language
  • Always-on desk assistant with LED visual state feedback
  • Embedded voice interface for robotics or kiosk projects

Esempio di workflow

INPUT

User says 'Hey Jarvis, what's the weather like today?'

AGENT
  1. 1

    openWakeWord detects the wake phrase and triggers a two-tone beep with blue LED

  2. 2

    _measure_ambient() samples 480ms of room noise to set dynamic VAD thresholds

  3. 3

    transcribe_stream() captures speech via VAD, sends audio to whisper.cpp CUDA server, returns transcript

  4. 4

    ask_llm() sends transcript plus 20-turn conversation history to OpenRouter API and receives response

  5. 5

    Piper TTS synthesizes the response offline and aplay outputs it while LED shows cyan then off

OUTPUT

Spoken answer played through ALSA speaker, LEDs return to off state

Requisiti

  • OPENROUTER_API_KEY environment variable
  • OpenRouter account (or self-hosted OpenAI-compatible LLM endpoint)
  • NVIDIA Jetson device with JetPack installed
  • ReSpeaker USB Mic Array v1.0 or compatible ALSA mic

Installazione

clawhub install nikil511/jetson-cuda-voice

Esegui il comando CLI oppure incolla il prompt in Claude Code, Cursor, Codex o nell'agente di coding che usi.

Link