Skip to content

[bot] Missing instrumentation for AWS Bedrock AgentCore Runtime Java SDK #142

Description

@braintrust-bot

Summary

The Braintrust Java SDK instruments software.amazon.awssdk:bedrockruntime (direct model invocation) and has an open gap issue (#113) for software.amazon.awssdk:bedrockagentruntime (the older Bedrock Agents/Knowledge-Bases feature). Neither covers software.amazon.awssdk:bedrockagentcore — a distinct, separately versioned AWS SDK v2 module for Amazon Bedrock AgentCore, AWS's newer, framework-agnostic managed runtime for deploying and invoking any agent (not limited to Bedrock-authored agents). This module is completely uninstrumented and is not the same client hierarchy as either existing/tracked Bedrock module.

What is missing

The software.amazon.awssdk:bedrockagentcore module provides these execution-oriented surfaces, none of which are instrumented:

API method Client Description
invokeAgentRuntime() BedrockAgentCoreClient / BedrockAgentCoreAsyncClient Sends a request to an agent (built with any framework — LangGraph, CrewAI, Strands, custom code, etc.) hosted on AgentCore Runtime and streams back its response
Session-scoped invocation BedrockAgentCoreClient Maintains conversation/session state across multiple invokeAgentRuntime calls via a runtime session identifier
AgentCore Memory / Gateway / Code Interpreter / Browser data-plane calls BedrockAgentCoreClient Additional AgentCore execution primitives (short/long-term memory retrieval, tool gateway invocation, sandboxed code execution) exposed by the same client

There is no reference to bedrockagentcore, BedrockAgentCore, or InvokeAgentRuntime anywhere in this repository — no instrumentation module, wrapper, test, example, or dependency.

Why this is not covered by the existing Bedrock work

  • aws_bedrock_2_30_0 (instrumented) targets BedrockRuntimeClientBuilder/BedrockRuntimeAsyncClientBuilder only (model invocation via Converse/InvokeModel).
  • Issue [bot] Missing instrumentation for AWS Bedrock Agent Runtime Java SDK #113 tracks bedrockagentruntime (InvokeAgent, RetrieveAndGenerate, Retrieve) — the older Bedrock Agents/Knowledge-Bases feature tied to agents authored specifically in Bedrock's agent builder.
  • bedrockagentcore is a separate, newer AWS service (Bedrock AgentCore, generally available in 2025) with its own Maven artifact, its own client class (BedrockAgentCoreClient), and its own API operation (InvokeAgentRuntime) for hosting/invoking agents built with any framework. It is not a version bump or superset of bedrockagentruntime — both remain independently published AWS services/SDKs today.

Braintrust docs status

Upstream sources

Local files inspected

  • braintrust-sdk/instrumentation/aws_bedrock_2_30_0/build.gradle — depends on software.amazon.awssdk:bedrockruntime only
  • braintrust-sdk/instrumentation/aws_bedrock_2_30_0/src/main/java/dev/braintrust/instrumentation/awsbedrock/v2_30_0/auto/AWSBedrockInstrumentationModule.javainstanceof checks limit instrumentation to BedrockRuntimeClientBuilder/BedrockRuntimeAsyncClientBuilder
  • settings.gradle (lines 28–33) — lists all instrumentation modules; no AgentCore module present
  • Full-repo grep for bedrockagentcore, BedrockAgentCore, InvokeAgentRuntime — zero matches

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions