azure-ai-voicelive-py
thegovind 제작
DevOps & Cloud요약
Build real-time voice AI applications.
설명
이 스킬이 하는 일
Wraps the Azure AI Voice Live SDK to enable real-time bidirectional voice applications in Python over WebSocket. Handles audio streaming, voice activity detection, transcription, and function calling in a single async API. Supports voice assistants, speech-to-speech translation, and voice-driven avatars.
Abstracts raw WebSocket management, audio encoding, and VAD logic so application code focuses on conversation flow rather than protocol details.
사용 시점
- Voice assistant that listens via microphone and responds with spoken audio
- Real-time speech-to-speech translation during a live call
- Hands-free command interface for a Python desktop or server app
- Voice-enabled customer support bot with interrupt and turn detection
- Voice-driven avatar that reacts to live audio input
예시 워크플로
User asks: Build a Python voice assistant that listens to microphone input and responds with audio
- 1
Connect to Azure Cognitive Services endpoint using DefaultAzureCredential
- 2
Configure session with instructions, voice selection, and Server VAD settings
- 3
Stream base64-encoded PCM16 audio chunks to conn.input_audio_buffer
- 4
Listen for response.audio.delta events and decode audio bytes for playback
- 5
Handle response.function_call_arguments.done to execute tools and return results to the conversation
An async Python app with real-time bidirectional voice conversation, automatic turn detection, and optional tool/function calling
요구 사항
- AZURE_COGNITIVE_SERVICES_ENDPOINT environment variable
- AZURE_COGNITIVE_SERVICES_KEY environment variable (or Azure AD credentials configured for DefaultAzureCredential)
- Azure Cognitive Services account with access to the Voice Live API
설치
clawhub install thegovind/azure-ai-voicelive-pyCLI 명령을 실행하거나, 프롬프트를 Claude Code, Cursor, Codex 등 사용하는 코딩 에이전트에 붙여넣으세요.