Lewati ke konten
TakoAPI
Kembali ke skill

jetson-cuda-voice

oleh nikil511

DevOps & Cloud
314Unduhan dilaporkan oleh clawskills.sh
0Tayangan
0 sukaMasuk untuk menyukai skill ini
—Belum ada penilaian
Penilaian Anda

Ringkasan

Fully offline, CUDA-accelerated local voice assistant pipeline for NVIDIA Jetson.

Deskripsi

Apa yang Dilakukan Skill Ini

Offline voice assistant pipeline for NVIDIA Jetson devices. Chains wake word detection, voice activity detection, GPU-accelerated speech-to-text, LLM inference, and neural TTS. Only the LLM call requires internet access.

Running STT and TTS fully on-device eliminates round-trip latency and keeps audio data off third-party servers, which cloud-dependent pipelines cannot offer.

Kapan Menggunakannya

  • Hands-free home automation control on a Jetson-based device
  • Private voice queries without sending audio to cloud STT services
  • Multilingual voice assistant that auto-detects spoken language
  • Always-on desk assistant with LED visual state feedback
  • Embedded voice interface for robotics or kiosk projects

Contoh Alur Kerja

INPUT

User says 'Hey Jarvis, what's the weather like today?'

AGENT
  1. 1

    openWakeWord detects the wake phrase and triggers a two-tone beep with blue LED

  2. 2

    _measure_ambient() samples 480ms of room noise to set dynamic VAD thresholds

  3. 3

    transcribe_stream() captures speech via VAD, sends audio to whisper.cpp CUDA server, returns transcript

  4. 4

    ask_llm() sends transcript plus 20-turn conversation history to OpenRouter API and receives response

  5. 5

    Piper TTS synthesizes the response offline and aplay outputs it while LED shows cyan then off

OUTPUT

Spoken answer played through ALSA speaker, LEDs return to off state

Persyaratan

  • OPENROUTER_API_KEY environment variable
  • OpenRouter account (or self-hosted OpenAI-compatible LLM endpoint)
  • NVIDIA Jetson device with JetPack installed
  • ReSpeaker USB Mic Array v1.0 or compatible ALSA mic

Instalasi

clawhub install nikil511/jetson-cuda-voice

Jalankan perintah CLI-nya, atau tempel prompt ke Claude Code, Cursor, Codex, atau coding agent apa pun yang Anda pakai.

Tautan