-
Notifications
You must be signed in to change notification settings - Fork 3.2k
[VoiceLive]Add Foundry agent integration, filler response configuration, and reasoning effort control #44773
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Conversation
…on, and reasoning effort control
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Pull request overview
This pull request adds significant new functionality to the Azure AI VoiceLive SDK, including Foundry agent integration, filler response configuration, and reasoning effort control. The PR also includes important security improvements by removing eval() usage from serialization utilities.
Changes:
- Added Foundry agent tool integration with
FoundryAgentTool, related events, and response items - Added filler response configuration with
BasicFillerResponseConfigandLlmFillerResponseConfigfor handling latency and tool call scenarios - Added
ReasoningEffortenum for controlling reasoning model effort levels - Added metadata support to Response models
- Removed security vulnerability by replacing
eval()with explicit type checking in serialization - Updated azure-core dependency from 1.36.0 to 1.37.0
Reviewed changes
Copilot reviewed 12 out of 12 changed files in this pull request and generated 6 comments.
Show a summary per file
| File | Description |
|---|---|
| azure/ai/voicelive/models/_models.py | Added new model classes for Foundry agents, filler responses, and server events; added reasoning_effort and metadata fields to existing models |
| azure/ai/voicelive/models/_enums.py | Added FillerResponseConfigType, FillerTrigger, FoundryAgentContextType, and ReasoningEffort enums |
| azure/ai/voicelive/models/init.py | Exported all new models and enums |
| azure/ai/voicelive/_utils/serialization.py | Replaced eval() with explicit type checking for improved security |
| azure/ai/voicelive/_utils/model_base.py | Enhanced deserialization for array-encoded strings and mutable types |
| azure/ai/voicelive/_types.py | Added FillerResponseConfig union type |
| tests/test_unit_models_filler_foundry.py | Comprehensive unit tests for new Foundry agent and filler response features |
| tests/test_unit_serialization.py | Security tests verifying eval() removal |
| samples/async_mcp_sample.py | Updated to use new API version and improved code formatting |
| pyproject.toml | Updated azure-core dependency to 1.37.0 |
| CHANGELOG.md | Comprehensive documentation of changes |
| apiview-properties.json | Added mappings for new models |
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
API Change CheckAPIView identified API level changes in this PR and created the following API reviews |
…on, and reasoning effort control
Description
Please add an informative description that covers that changes made by the pull request and link all relevant issues.
If an SDK is being regenerated based on a new API spec, a link to the pull request containing these API spec changes should be included above.
All SDK Contribution checklist:
General Guidelines and Best Practices
Testing Guidelines