Skip to content

[bot] Missing instrumentation for Azure AI Foundry Agents Java SDK (azure-ai-agents-persistent) #149

Description

@braintrust-bot

Summary

The Braintrust Java SDK instruments the Azure OpenAI-adjacent surface only indirectly via unrelated modules and has an open gap issue for com.azure:azure-ai-openai (#68) and com.azure:azure-ai-inference (#118), but does not instrument — and no open issue tracks — com.azure:azure-ai-agents-persistent, Microsoft's official Java SDK for Azure AI Foundry Agent Service. This is a distinct Maven artifact and client hierarchy (PersistentAgentsClient) providing a stateful, server-side agent-run execution surface (threads, runs, tool calls) comparable in kind to OpenAI's Assistants/Responses agent-run APIs.

What is missing

The com.azure:azure-ai-agents-persistent SDK provides these execution-oriented surfaces, none of which are instrumented:

API Class Description
createAgent() PersistentAgentsClient Defines a server-hosted agent (model, instructions, tools)
createThread() / createMessage() PersistentAgentsClient Manages a persistent conversation thread that an agent run executes over
createRun() / createRunAsync() / streaming run updates PersistentAgentsClient Executes an agent run against a thread — the core "agent execution" surface, including tool-call submission (submitToolOutputsToRun) and run status polling/streaming
createThreadAndRun() PersistentAgentsClient Combined thread-creation-and-run execution

Why existing instrumentation does not cover this

Braintrust docs status

Upstream sources

Local repo files inspected

  • settings.gradle (lines 28–33) — lists all instrumentation modules; no Azure Agents module present
  • braintrust-sdk/instrumentation/ — contains openai_2_15_0, anthropic_2_2_0, genai_1_18_0, langchain_1_8_0, springai_1_0_0, aws_bedrock_2_30_0; no Azure directory
  • Full-repo grep for azure.ai.agents, azure-ai-agents, PersistentAgent — zero matches

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions