azure-ai-voicelive-py
oleh thegovind
DevOps & CloudRingkasan
Build real-time voice AI applications.
Deskripsi
Apa yang Dilakukan Skill Ini
Wraps the Azure AI Voice Live SDK to enable real-time bidirectional voice applications in Python over WebSocket. Handles audio streaming, voice activity detection, transcription, and function calling in a single async API. Supports voice assistants, speech-to-speech translation, and voice-driven avatars.
Abstracts raw WebSocket management, audio encoding, and VAD logic so application code focuses on conversation flow rather than protocol details.
Kapan Menggunakannya
- Voice assistant that listens via microphone and responds with spoken audio
- Real-time speech-to-speech translation during a live call
- Hands-free command interface for a Python desktop or server app
- Voice-enabled customer support bot with interrupt and turn detection
- Voice-driven avatar that reacts to live audio input
Contoh Alur Kerja
User asks: Build a Python voice assistant that listens to microphone input and responds with audio
- 1
Connect to Azure Cognitive Services endpoint using DefaultAzureCredential
- 2
Configure session with instructions, voice selection, and Server VAD settings
- 3
Stream base64-encoded PCM16 audio chunks to conn.input_audio_buffer
- 4
Listen for response.audio.delta events and decode audio bytes for playback
- 5
Handle response.function_call_arguments.done to execute tools and return results to the conversation
An async Python app with real-time bidirectional voice conversation, automatic turn detection, and optional tool/function calling
Persyaratan
- AZURE_COGNITIVE_SERVICES_ENDPOINT environment variable
- AZURE_COGNITIVE_SERVICES_KEY environment variable (or Azure AD credentials configured for DefaultAzureCredential)
- Azure Cognitive Services account with access to the Voice Live API
Instalasi
clawhub install thegovind/azure-ai-voicelive-pyJalankan perintah CLI-nya, atau tempel prompt ke Claude Code, Cursor, Codex, atau coding agent apa pun yang Anda pakai.