Vai al contenuto
TakoAPI
Torna alle skill

azure-ai-voicelive-py

di thegovind

DevOps & Cloud
1.8kDownload riportati da clawskills.sh
2Stelle
1Visualizzazioni
0 likeAccedi per mettere like a questa skill
—Non ancora valutato
La tua valutazione

Sintesi

Build real-time voice AI applications.

Descrizione

Cosa fa questa skill

Wraps the Azure AI Voice Live SDK to enable real-time bidirectional voice applications in Python over WebSocket. Handles audio streaming, voice activity detection, transcription, and function calling in a single async API. Supports voice assistants, speech-to-speech translation, and voice-driven avatars.

Abstracts raw WebSocket management, audio encoding, and VAD logic so application code focuses on conversation flow rather than protocol details.

Quando usarla

  • Voice assistant that listens via microphone and responds with spoken audio
  • Real-time speech-to-speech translation during a live call
  • Hands-free command interface for a Python desktop or server app
  • Voice-enabled customer support bot with interrupt and turn detection
  • Voice-driven avatar that reacts to live audio input

Esempio di workflow

INPUT

User asks: Build a Python voice assistant that listens to microphone input and responds with audio

AGENT
  1. 1

    Connect to Azure Cognitive Services endpoint using DefaultAzureCredential

  2. 2

    Configure session with instructions, voice selection, and Server VAD settings

  3. 3

    Stream base64-encoded PCM16 audio chunks to conn.input_audio_buffer

  4. 4

    Listen for response.audio.delta events and decode audio bytes for playback

  5. 5

    Handle response.function_call_arguments.done to execute tools and return results to the conversation

OUTPUT

An async Python app with real-time bidirectional voice conversation, automatic turn detection, and optional tool/function calling

Requisiti

  • AZURE_COGNITIVE_SERVICES_ENDPOINT environment variable
  • AZURE_COGNITIVE_SERVICES_KEY environment variable (or Azure AD credentials configured for DefaultAzureCredential)
  • Azure Cognitive Services account with access to the Voice Live API

Installazione

clawhub install thegovind/azure-ai-voicelive-py

Esegui il comando CLI oppure incolla il prompt in Claude Code, Cursor, Codex o nell'agente di coding che usi.

Link