azure-ai-voicelive-py
bởi thegovind
DevOps & CloudTóm tắt
Build real-time voice AI applications.
Mô tả
Kỹ năng này làm gì
Wraps the Azure AI Voice Live SDK to enable real-time bidirectional voice applications in Python over WebSocket. Handles audio streaming, voice activity detection, transcription, and function calling in a single async API. Supports voice assistants, speech-to-speech translation, and voice-driven avatars.
Abstracts raw WebSocket management, audio encoding, and VAD logic so application code focuses on conversation flow rather than protocol details.
Khi nào nên dùng
- Voice assistant that listens via microphone and responds with spoken audio
- Real-time speech-to-speech translation during a live call
- Hands-free command interface for a Python desktop or server app
- Voice-enabled customer support bot with interrupt and turn detection
- Voice-driven avatar that reacts to live audio input
Quy trình ví dụ
User asks: Build a Python voice assistant that listens to microphone input and responds with audio
- 1
Connect to Azure Cognitive Services endpoint using DefaultAzureCredential
- 2
Configure session with instructions, voice selection, and Server VAD settings
- 3
Stream base64-encoded PCM16 audio chunks to conn.input_audio_buffer
- 4
Listen for response.audio.delta events and decode audio bytes for playback
- 5
Handle response.function_call_arguments.done to execute tools and return results to the conversation
An async Python app with real-time bidirectional voice conversation, automatic turn detection, and optional tool/function calling
Yêu cầu
- AZURE_COGNITIVE_SERVICES_ENDPOINT environment variable
- AZURE_COGNITIVE_SERVICES_KEY environment variable (or Azure AD credentials configured for DefaultAzureCredential)
- Azure Cognitive Services account with access to the Voice Live API
Cài đặt
clawhub install thegovind/azure-ai-voicelive-pyChạy lệnh CLI, hoặc dán prompt vào Claude Code, Cursor, Codex hay coding agent bạn đang dùng.