跳到正文
TakoAPI
返回技能列表

azure-ai-voicelive-py

由 thegovind 提供

DevOps & Cloud
1.8k下载量由 clawskills.sh 提供
2星标
1浏览量
0 个赞登录后即可为这个技能点赞
—暂无评分
你的评分

简介

Build real-time voice AI applications.

描述

该技能的功能

Wraps the Azure AI Voice Live SDK to enable real-time bidirectional voice applications in Python over WebSocket. Handles audio streaming, voice activity detection, transcription, and function calling in a single async API. Supports voice assistants, speech-to-speech translation, and voice-driven avatars.

Abstracts raw WebSocket management, audio encoding, and VAD logic so application code focuses on conversation flow rather than protocol details.

何时使用

  • Voice assistant that listens via microphone and responds with spoken audio
  • Real-time speech-to-speech translation during a live call
  • Hands-free command interface for a Python desktop or server app
  • Voice-enabled customer support bot with interrupt and turn detection
  • Voice-driven avatar that reacts to live audio input

示例工作流

输入

User asks: Build a Python voice assistant that listens to microphone input and responds with audio

智能体
  1. 1

    Connect to Azure Cognitive Services endpoint using DefaultAzureCredential

  2. 2

    Configure session with instructions, voice selection, and Server VAD settings

  3. 3

    Stream base64-encoded PCM16 audio chunks to conn.input_audio_buffer

  4. 4

    Listen for response.audio.delta events and decode audio bytes for playback

  5. 5

    Handle response.function_call_arguments.done to execute tools and return results to the conversation

输出

An async Python app with real-time bidirectional voice conversation, automatic turn detection, and optional tool/function calling

前置要求

  • AZURE_COGNITIVE_SERVICES_ENDPOINT environment variable
  • AZURE_COGNITIVE_SERVICES_KEY environment variable (or Azure AD credentials configured for DefaultAzureCredential)
  • Azure Cognitive Services account with access to the Voice Live API

安装

clawhub install thegovind/azure-ai-voicelive-py

运行 CLI 命令,或把这段提示词粘贴到 Claude Code、Cursor、Codex 或你在用的任意编程智能体里。

链接