Pular para o conteúdo
TakoAPI
Voltar às skills

azure-ai-voicelive-py

por thegovind

DevOps & Cloud
1.8kDownloads informados pelo clawskills.sh
2Estrelas
1Visualizações
0 curtidaEntre para curtir esta skill
—Ainda sem avaliações
Sua avaliação

Resumo

Build real-time voice AI applications.

Descrição

O que esta skill faz

Wraps the Azure AI Voice Live SDK to enable real-time bidirectional voice applications in Python over WebSocket. Handles audio streaming, voice activity detection, transcription, and function calling in a single async API. Supports voice assistants, speech-to-speech translation, and voice-driven avatars.

Abstracts raw WebSocket management, audio encoding, and VAD logic so application code focuses on conversation flow rather than protocol details.

Quando usá-la

  • Voice assistant that listens via microphone and responds with spoken audio
  • Real-time speech-to-speech translation during a live call
  • Hands-free command interface for a Python desktop or server app
  • Voice-enabled customer support bot with interrupt and turn detection
  • Voice-driven avatar that reacts to live audio input

Exemplo de fluxo de trabalho

ENTRADA

User asks: Build a Python voice assistant that listens to microphone input and responds with audio

AGENTE
  1. 1

    Connect to Azure Cognitive Services endpoint using DefaultAzureCredential

  2. 2

    Configure session with instructions, voice selection, and Server VAD settings

  3. 3

    Stream base64-encoded PCM16 audio chunks to conn.input_audio_buffer

  4. 4

    Listen for response.audio.delta events and decode audio bytes for playback

  5. 5

    Handle response.function_call_arguments.done to execute tools and return results to the conversation

SAÍDA

An async Python app with real-time bidirectional voice conversation, automatic turn detection, and optional tool/function calling

Requisitos

  • AZURE_COGNITIVE_SERVICES_ENDPOINT environment variable
  • AZURE_COGNITIVE_SERVICES_KEY environment variable (or Azure AD credentials configured for DefaultAzureCredential)
  • Azure Cognitive Services account with access to the Voice Live API

Instalação

clawhub install thegovind/azure-ai-voicelive-py

Execute o comando da CLI ou cole o prompt no Claude Code, Cursor, Codex ou no agente de código que você usa.

Links