본문으로 건너뛰기
TakoAPI
스킬로 돌아가기

azure-ai-voicelive-py

thegovind 제작

DevOps & Cloud
1.8kclawskills.sh가 보고한 다운로드 수
2스타
1조회수
좋아요 0개로그인하면 이 스킬에 좋아요를 누를 수 있습니다
—아직 평가 없음
내 평가

요약

Build real-time voice AI applications.

설명

이 스킬이 하는 일

Wraps the Azure AI Voice Live SDK to enable real-time bidirectional voice applications in Python over WebSocket. Handles audio streaming, voice activity detection, transcription, and function calling in a single async API. Supports voice assistants, speech-to-speech translation, and voice-driven avatars.

Abstracts raw WebSocket management, audio encoding, and VAD logic so application code focuses on conversation flow rather than protocol details.

사용 시점

  • Voice assistant that listens via microphone and responds with spoken audio
  • Real-time speech-to-speech translation during a live call
  • Hands-free command interface for a Python desktop or server app
  • Voice-enabled customer support bot with interrupt and turn detection
  • Voice-driven avatar that reacts to live audio input

예시 워크플로

입력

User asks: Build a Python voice assistant that listens to microphone input and responds with audio

에이전트
  1. 1

    Connect to Azure Cognitive Services endpoint using DefaultAzureCredential

  2. 2

    Configure session with instructions, voice selection, and Server VAD settings

  3. 3

    Stream base64-encoded PCM16 audio chunks to conn.input_audio_buffer

  4. 4

    Listen for response.audio.delta events and decode audio bytes for playback

  5. 5

    Handle response.function_call_arguments.done to execute tools and return results to the conversation

출력

An async Python app with real-time bidirectional voice conversation, automatic turn detection, and optional tool/function calling

요구 사항

  • AZURE_COGNITIVE_SERVICES_ENDPOINT environment variable
  • AZURE_COGNITIVE_SERVICES_KEY environment variable (or Azure AD credentials configured for DefaultAzureCredential)
  • Azure Cognitive Services account with access to the Voice Live API

설치

clawhub install thegovind/azure-ai-voicelive-py

CLI 명령을 실행하거나, 프롬프트를 Claude Code, Cursor, Codex 등 사용하는 코딩 에이전트에 붙여넣으세요.

링크