Skip to content

feat(llmobs): implement multi-tenant routing context support#15781

Closed
PROFeNoM wants to merge 18 commits intomainfrom
alex/MLOB-4999_multi-tenant-routing-context-support
Closed

feat(llmobs): implement multi-tenant routing context support#15781
PROFeNoM wants to merge 18 commits intomainfrom
alex/MLOB-4999_multi-tenant-routing-context-support

Conversation

@PROFeNoM
Copy link
Copy Markdown
Contributor

@PROFeNoM PROFeNoM commented Dec 24, 2025 •
edited
Loading

Description

Adds multi-tenant routing support to LLM Observability, enabling platforms to route telemetry to different Datadog organizations from a single process.

New Public API

  with LLMObs.routing_context(dd_api_key=customer_key, dd_site=customer_site):
      # Spans are routed to customer's Datadog org
      pass

Motivation

Multi-tenant AI platforms (e.g., Dust.tt) need to send LLM Observability data to their customers' Datadog organizations. This enables:

  • Customer-specific trace visibility in their own Datadog account
  • Data isolation between tenants
  • Compliance with data residency requirements (different DD sites per customer)

Implementation

routing_context(api_key, site)
    ↓ contextvars
_start_span()
    ↓ captures routing to span metadata
span.finish()
    ↓
_submit_llmobs_span()
    ↓ extracts routing
writer.enqueue(event, routing)
    ↓ routes to correct buffer
periodic()
    ↓ flushes each buffer to its endpoint

Key details:

  • Uses contextvars for thread-safe and async-safe context propagation
  • Writer refactored to multi-buffer architecture (one buffer per api_key:site)
  • Each buffer flushes independently to its corresponding endpoint
  • Agentless mode only (by design)

Backward Compatibility

  • enqueue() signature adds optional routing parameter with default None
  • Existing behavior unchanged when routing_context is not used
  • All internal changes are to private methods

Security

  • API keys are never serialized into span payloads
  • API keys are never logged (only used in HTTP headers)
  • Buffers are isolated per routing key (no cross-tenant data leakage)

Testing

  • test_llmobs_routing.py Unit tests for RoutingContext validation and writer multi-buffer behavior
  • test_llmobs_routing_integration.py Integration tests for full span lifecycle, async isolation, flush behavior, and security

Related

github-advanced-security[bot]
github-advanced-security AI found potential problems Dec 24, 2025
View reviewed changes
Comment thread tests/llmobs/test_multi_tenant_integration.py Fixed
Comment thread tests/llmobs/test_multi_tenant_integration.py Fixed
Comment thread tests/llmobs/test_multi_tenant_integration.py Fixed
Comment thread tests/llmobs/test_multi_tenant_integration.py Fixed
@PROFeNoM
Copy link
Copy Markdown
Contributor Author

PROFeNoM commented Dec 24, 2025

@codex review

@chatgpt-codex-connector
Copy link
Copy Markdown

chatgpt-codex-connector Bot commented Dec 24, 2025

To use Codex here, create a Codex account and connect to github.

github-advanced-security[bot]
github-advanced-security AI found potential problems Dec 24, 2025
View reviewed changes
Comment thread tests/llmobs/test_llmobs_routing_integration.py Fixed
Comment thread tests/llmobs/test_llmobs_routing_integration.py Fixed
@PROFeNoM PROFeNoM changed the title wip feat(llmobs): implement multi-tenant routing context support Dec 24, 2025
@pr-commenter
Copy link
Copy Markdown

pr-commenter Bot commented Dec 24, 2025 •
edited
Loading

Performance SLOs

Comparing candidate alex/MLOB-4999_multi-tenant-routing-context-support (2c11fcf) with baseline main (e327013)

📈 Performance Regressions (3 suites)
📈 iastaspects - 118/118

✅ add_aspect

Time: ✅ 17.940µs (SLO: <20.000µs 📉 -10.3%) vs baseline: 📈 +21.3%

Memory: ✅ 42.585MB (SLO: <43.250MB 🟡 -1.5%) vs baseline: +4.9%

✅ add_inplace_aspect

Time: ✅ 14.976µs (SLO: <20.000µs 📉 -25.1%) vs baseline: +0.8%

Memory: ✅ 42.546MB (SLO: <43.250MB 🟡 -1.6%) vs baseline: +4.8%

✅ add_inplace_noaspect

Time: ✅ 0.339µs (SLO: <10.000µs 📉 -96.6%) vs baseline: -0.6%

Memory: ✅ 42.546MB (SLO: <43.500MB -2.2%) vs baseline: +4.5%

✅ add_noaspect

Time: ✅ 0.548µs (SLO: <10.000µs 📉 -94.5%) vs baseline: +0.5%

Memory: ✅ 42.585MB (SLO: <43.500MB -2.1%) vs baseline: +5.0%

✅ bytearray_aspect

Time: ✅ 18.052µs (SLO: <30.000µs 📉 -39.8%) vs baseline: ~same

Memory: ✅ 42.605MB (SLO: <43.500MB -2.1%) vs baseline: +4.9%

✅ bytearray_extend_aspect

Time: ✅ 23.867µs (SLO: <30.000µs 📉 -20.4%) vs baseline: +0.6%

Memory: ✅ 42.625MB (SLO: <43.500MB -2.0%) vs baseline: +5.1%

✅ bytearray_extend_noaspect

Time: ✅ 2.764µs (SLO: <10.000µs 📉 -72.4%) vs baseline: +0.2%

Memory: ✅ 42.605MB (SLO: <43.500MB -2.1%) vs baseline: +4.9%

✅ bytearray_noaspect

Time: ✅ 1.468µs (SLO: <10.000µs 📉 -85.3%) vs baseline: -1.5%

Memory: ✅ 42.546MB (SLO: <43.500MB -2.2%) vs baseline: +4.8%

✅ bytes_aspect

Time: ✅ 16.793µs (SLO: <20.000µs 📉 -16.0%) vs baseline: +1.3%

Memory: ✅ 42.684MB (SLO: <43.500MB 🟡 -1.9%) vs baseline: +5.1%

✅ bytes_noaspect

Time: ✅ 1.416µs (SLO: <10.000µs 📉 -85.8%) vs baseline: -1.0%

Memory: ✅ 42.585MB (SLO: <43.500MB -2.1%) vs baseline: +4.9%

✅ bytesio_aspect

Time: ✅ 55.380µs (SLO: <70.000µs 📉 -20.9%) vs baseline: ~same

Memory: ✅ 42.566MB (SLO: <43.500MB -2.1%) vs baseline: +4.8%

✅ bytesio_noaspect

Time: ✅ 3.295µs (SLO: <10.000µs 📉 -67.1%) vs baseline: +0.8%

Memory: ✅ 42.625MB (SLO: <43.500MB -2.0%) vs baseline: +5.0%

✅ capitalize_aspect

Time: ✅ 14.629µs (SLO: <20.000µs 📉 -26.9%) vs baseline: ~same

Memory: ✅ 42.605MB (SLO: <43.500MB -2.1%) vs baseline: +5.0%

✅ capitalize_noaspect

Time: ✅ 2.574µs (SLO: <10.000µs 📉 -74.3%) vs baseline: -0.1%

Memory: ✅ 42.507MB (SLO: <43.500MB -2.3%) vs baseline: +4.7%

✅ casefold_aspect

Time: ✅ 14.663µs (SLO: <20.000µs 📉 -26.7%) vs baseline: +0.2%

Memory: ✅ 42.703MB (SLO: <43.500MB 🟡 -1.8%) vs baseline: +5.1%

✅ casefold_noaspect

Time: ✅ 3.153µs (SLO: <10.000µs 📉 -68.5%) vs baseline: -0.9%

Memory: ✅ 42.566MB (SLO: <43.500MB -2.1%) vs baseline: +4.8%

✅ decode_aspect

Time: ✅ 15.542µs (SLO: <30.000µs 📉 -48.2%) vs baseline: ~same

Memory: ✅ 42.566MB (SLO: <43.500MB -2.1%) vs baseline: +4.9%

✅ decode_noaspect

Time: ✅ 1.590µs (SLO: <10.000µs 📉 -84.1%) vs baseline: -0.5%

Memory: ✅ 42.625MB (SLO: <43.500MB -2.0%) vs baseline: +5.0%

✅ encode_aspect

Time: ✅ 18.128µs (SLO: <30.000µs 📉 -39.6%) vs baseline: 📈 +23.0%

Memory: ✅ 42.566MB (SLO: <43.500MB -2.1%) vs baseline: +4.9%

✅ encode_noaspect

Time: ✅ 1.496µs (SLO: <10.000µs 📉 -85.0%) vs baseline: -0.3%

Memory: ✅ 42.546MB (SLO: <43.500MB -2.2%) vs baseline: +4.7%

✅ format_aspect

Time: ✅ 171.115µs (SLO: <200.000µs 📉 -14.4%) vs baseline: ~same

Memory: ✅ 42.664MB (SLO: <43.250MB 🟡 -1.4%) vs baseline: +4.6%

✅ format_map_aspect

Time: ✅ 190.937µs (SLO: <200.000µs -4.5%) vs baseline: +0.2%

Memory: ✅ 42.802MB (SLO: <43.500MB 🟡 -1.6%) vs baseline: +4.8%

✅ format_map_noaspect

Time: ✅ 3.780µs (SLO: <10.000µs 📉 -62.2%) vs baseline: -1.0%

Memory: ✅ 42.625MB (SLO: <43.250MB 🟡 -1.4%) vs baseline: +5.0%

✅ format_noaspect

Time: ✅ 3.182µs (SLO: <10.000µs 📉 -68.2%) vs baseline: +1.2%

Memory: ✅ 42.507MB (SLO: <43.250MB 🟡 -1.7%) vs baseline: +4.6%

✅ index_aspect

Time: ✅ 15.406µs (SLO: <20.000µs 📉 -23.0%) vs baseline: +0.8%

Memory: ✅ 42.625MB (SLO: <43.250MB 🟡 -1.4%) vs baseline: +5.0%

✅ index_noaspect

Time: ✅ 0.462µs (SLO: <10.000µs 📉 -95.4%) vs baseline: -0.3%

Memory: ✅ 42.664MB (SLO: <43.500MB 🟡 -1.9%) vs baseline: +5.1%

✅ join_aspect

Time: ✅ 16.989µs (SLO: <20.000µs 📉 -15.1%) vs baseline: +0.3%

Memory: ✅ 42.585MB (SLO: <43.500MB -2.1%) vs baseline: +5.0%

✅ join_noaspect

Time: ✅ 1.547µs (SLO: <10.000µs 📉 -84.5%) vs baseline: -0.7%

Memory: ✅ 42.566MB (SLO: <43.250MB 🟡 -1.6%) vs baseline: +4.7%

✅ ljust_aspect

Time: ✅ 20.688µs (SLO: <30.000µs 📉 -31.0%) vs baseline: +0.2%

Memory: ✅ 42.684MB (SLO: <43.250MB 🟡 -1.3%) vs baseline: +5.1%

✅ ljust_noaspect

Time: ✅ 2.720µs (SLO: <10.000µs 📉 -72.8%) vs baseline: +0.6%

Memory: ✅ 42.585MB (SLO: <43.250MB 🟡 -1.5%) vs baseline: +4.6%

✅ lower_aspect

Time: ✅ 17.979µs (SLO: <30.000µs 📉 -40.1%) vs baseline: +1.0%

Memory: ✅ 42.605MB (SLO: <43.500MB -2.1%) vs baseline: +4.9%

✅ lower_noaspect

Time: ✅ 2.431µs (SLO: <10.000µs 📉 -75.7%) vs baseline: -0.3%

Memory: ✅ 42.546MB (SLO: <43.250MB 🟡 -1.6%) vs baseline: +4.8%

✅ lstrip_aspect

Time: ✅ 17.771µs (SLO: <30.000µs 📉 -40.8%) vs baseline: +0.8%

Memory: ✅ 42.605MB (SLO: <43.250MB 🟡 -1.5%) vs baseline: +4.7%

✅ lstrip_noaspect

Time: ✅ 1.859µs (SLO: <10.000µs 📉 -81.4%) vs baseline: -0.8%

Memory: ✅ 42.507MB (SLO: <43.500MB -2.3%) vs baseline: +4.7%

✅ modulo_aspect

Time: ✅ 166.247µs (SLO: <200.000µs 📉 -16.9%) vs baseline: +0.2%

Memory: ✅ 42.644MB (SLO: <43.500MB 🟡 -2.0%) vs baseline: +4.7%

✅ modulo_aspect_for_bytearray_bytearray

Time: ✅ 174.237µs (SLO: <200.000µs 📉 -12.9%) vs baseline: +0.3%

Memory: ✅ 42.625MB (SLO: <43.500MB -2.0%) vs baseline: +4.5%

✅ modulo_aspect_for_bytes

Time: ✅ 168.619µs (SLO: <200.000µs 📉 -15.7%) vs baseline: ~same

Memory: ✅ 42.625MB (SLO: <43.500MB -2.0%) vs baseline: +4.6%

✅ modulo_aspect_for_bytes_bytearray

Time: ✅ 171.266µs (SLO: <200.000µs 📉 -14.4%) vs baseline: -0.1%

Memory: ✅ 42.546MB (SLO: <43.500MB -2.2%) vs baseline: +4.3%

✅ modulo_noaspect

Time: ✅ 3.673µs (SLO: <10.000µs 📉 -63.3%) vs baseline: -0.4%

Memory: ✅ 42.585MB (SLO: <43.500MB -2.1%) vs baseline: +5.0%

✅ replace_aspect

Time: ✅ 219.585µs (SLO: <300.000µs 📉 -26.8%) vs baseline: +3.6%

Memory: ✅ 42.684MB (SLO: <44.000MB -3.0%) vs baseline: +4.3%

✅ replace_noaspect

Time: ✅ 2.899µs (SLO: <10.000µs 📉 -71.0%) vs baseline: ~same

Memory: ✅ 42.625MB (SLO: <43.500MB -2.0%) vs baseline: +4.9%

✅ repr_aspect

Time: ✅ 1.431µs (SLO: <10.000µs 📉 -85.7%) vs baseline: +1.8%

Memory: ✅ 42.644MB (SLO: <43.500MB 🟡 -2.0%) vs baseline: +4.8%

✅ repr_noaspect

Time: ✅ 0.524µs (SLO: <10.000µs 📉 -94.8%) vs baseline: -0.2%

Memory: ✅ 42.526MB (SLO: <43.500MB -2.2%) vs baseline: +4.8%

✅ rstrip_aspect

Time: ✅ 23.053µs (SLO: <30.000µs 📉 -23.2%) vs baseline: 📈 +21.0%

Memory: ✅ 42.664MB (SLO: <43.500MB 🟡 -1.9%) vs baseline: +5.1%

✅ rstrip_noaspect

Time: ✅ 1.932µs (SLO: <10.000µs 📉 -80.7%) vs baseline: +0.4%

Memory: ✅ 42.625MB (SLO: <43.500MB -2.0%) vs baseline: +5.1%

✅ slice_aspect

Time: ✅ 15.951µs (SLO: <20.000µs 📉 -20.2%) vs baseline: +0.2%

Memory: ✅ 42.625MB (SLO: <43.500MB -2.0%) vs baseline: +4.7%

✅ slice_noaspect

Time: ✅ 0.597µs (SLO: <10.000µs 📉 -94.0%) vs baseline: -0.5%

Memory: ✅ 42.585MB (SLO: <43.500MB -2.1%) vs baseline: +4.8%

✅ stringio_aspect

Time: ✅ 53.994µs (SLO: <80.000µs 📉 -32.5%) vs baseline: ~same

Memory: ✅ 42.605MB (SLO: <43.500MB -2.1%) vs baseline: +5.0%

✅ stringio_noaspect

Time: ✅ 3.651µs (SLO: <10.000µs 📉 -63.5%) vs baseline: -0.1%

Memory: ✅ 42.644MB (SLO: <43.500MB 🟡 -2.0%) vs baseline: +4.9%

✅ strip_aspect

Time: ✅ 17.596µs (SLO: <20.000µs 📉 -12.0%) vs baseline: -0.9%

Memory: ✅ 42.526MB (SLO: <43.500MB -2.2%) vs baseline: +4.8%

✅ strip_noaspect

Time: ✅ 1.868µs (SLO: <10.000µs 📉 -81.3%) vs baseline: +0.2%

Memory: ✅ 42.546MB (SLO: <43.500MB -2.2%) vs baseline: +4.7%

✅ swapcase_aspect

Time: ✅ 18.494µs (SLO: <30.000µs 📉 -38.4%) vs baseline: +0.4%

Memory: ✅ 42.605MB (SLO: <43.500MB -2.1%) vs baseline: +5.0%

✅ swapcase_noaspect

Time: ✅ 2.793µs (SLO: <10.000µs 📉 -72.1%) vs baseline: -0.5%

Memory: ✅ 42.605MB (SLO: <43.500MB -2.1%) vs baseline: +5.0%

✅ title_aspect

Time: ✅ 18.355µs (SLO: <30.000µs 📉 -38.8%) vs baseline: +1.3%

Memory: ✅ 42.605MB (SLO: <43.000MB 🟡 -0.9%) vs baseline: +5.0%

✅ title_noaspect

Time: ✅ 2.687µs (SLO: <10.000µs 📉 -73.1%) vs baseline: +0.7%

Memory: ✅ 42.585MB (SLO: <43.500MB -2.1%) vs baseline: +4.9%

✅ translate_aspect

Time: ✅ 24.151µs (SLO: <30.000µs 📉 -19.5%) vs baseline: 📈 +17.6%

Memory: ✅ 42.566MB (SLO: <43.500MB -2.1%) vs baseline: +4.7%

✅ translate_noaspect

Time: ✅ 4.328µs (SLO: <10.000µs 📉 -56.7%) vs baseline: +0.4%

Memory: ✅ 42.605MB (SLO: <43.500MB -2.1%) vs baseline: +4.9%

✅ upper_aspect

Time: ✅ 18.022µs (SLO: <30.000µs 📉 -39.9%) vs baseline: +0.8%

Memory: ✅ 42.546MB (SLO: <43.500MB -2.2%) vs baseline: +4.7%

✅ upper_noaspect

Time: ✅ 2.440µs (SLO: <10.000µs 📉 -75.6%) vs baseline: +0.4%

Memory: ✅ 42.684MB (SLO: <43.500MB 🟡 -1.9%) vs baseline: +5.2%

📈 iastaspectsospath - 24/24

✅ ospathbasename_aspect

Time: ✅ 5.169µs (SLO: <10.000µs 📉 -48.3%) vs baseline: 📈 +20.7%

Memory: ✅ 42.507MB (SLO: <43.500MB -2.3%) vs baseline: +4.7%

✅ ospathbasename_noaspect

Time: ✅ 4.319µs (SLO: <10.000µs 📉 -56.8%) vs baseline: -0.9%

Memory: ✅ 42.526MB (SLO: <43.500MB -2.2%) vs baseline: +4.7%

✅ ospathjoin_aspect

Time: ✅ 6.267µs (SLO: <10.000µs 📉 -37.3%) vs baseline: +0.1%

Memory: ✅ 42.526MB (SLO: <43.500MB -2.2%) vs baseline: +4.8%

✅ ospathjoin_noaspect

Time: ✅ 6.289µs (SLO: <10.000µs 📉 -37.1%) vs baseline: +0.1%

Memory: ✅ 42.507MB (SLO: <43.500MB -2.3%) vs baseline: +4.9%

✅ ospathnormcase_aspect

Time: ✅ 3.567µs (SLO: <10.000µs 📉 -64.3%) vs baseline: -0.8%

Memory: ✅ 42.448MB (SLO: <43.500MB -2.4%) vs baseline: +4.5%

✅ ospathnormcase_noaspect

Time: ✅ 3.637µs (SLO: <10.000µs 📉 -63.6%) vs baseline: +1.0%

Memory: ✅ 42.585MB (SLO: <43.500MB -2.1%) vs baseline: +4.9%

✅ ospathsplit_aspect

Time: ✅ 4.913µs (SLO: <10.000µs 📉 -50.9%) vs baseline: -0.5%

Memory: ✅ 42.467MB (SLO: <43.500MB -2.4%) vs baseline: +4.8%

✅ ospathsplit_noaspect

Time: ✅ 5.014µs (SLO: <10.000µs 📉 -49.9%) vs baseline: -0.2%

Memory: ✅ 42.467MB (SLO: <43.500MB -2.4%) vs baseline: +4.8%

✅ ospathsplitdrive_aspect

Time: ✅ 3.783µs (SLO: <10.000µs 📉 -62.2%) vs baseline: +0.8%

Memory: ✅ 42.467MB (SLO: <43.500MB -2.4%) vs baseline: +4.9%

✅ ospathsplitdrive_noaspect

Time: ✅ 0.746µs (SLO: <10.000µs 📉 -92.5%) vs baseline: ~same

Memory: ✅ 42.408MB (SLO: <43.500MB -2.5%) vs baseline: +4.4%

✅ ospathsplitext_aspect

Time: ✅ 4.669µs (SLO: <10.000µs 📉 -53.3%) vs baseline: +0.8%

Memory: ✅ 42.585MB (SLO: <43.500MB -2.1%) vs baseline: +4.9%

✅ ospathsplitext_noaspect

Time: ✅ 4.632µs (SLO: <10.000µs 📉 -53.7%) vs baseline: -0.5%

Memory: ✅ 42.644MB (SLO: <43.500MB 🟡 -2.0%) vs baseline: +5.1%

📈 telemetryaddmetric - 30/30

✅ 1-count-metric-1-times

Time: ✅ 3.394µs (SLO: <20.000µs 📉 -83.0%) vs baseline: 📈 +14.1%

Memory: ✅ 34.918MB (SLO: <35.500MB 🟡 -1.6%) vs baseline: +5.5%

✅ 1-count-metrics-100-times

Time: ✅ 200.359µs (SLO: <220.000µs -8.9%) vs baseline: +0.8%

Memory: ✅ 34.878MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +4.7%

✅ 1-distribution-metric-1-times

Time: ✅ 3.325µs (SLO: <20.000µs 📉 -83.4%) vs baseline: +0.2%

Memory: ✅ 34.918MB (SLO: <35.500MB 🟡 -1.6%) vs baseline: +5.2%

✅ 1-distribution-metrics-100-times

Time: ✅ 212.885µs (SLO: <230.000µs -7.4%) vs baseline: -0.2%

Memory: ✅ 34.898MB (SLO: <35.500MB 🟡 -1.7%) vs baseline: +4.9%

✅ 1-gauge-metric-1-times

Time: ✅ 2.159µs (SLO: <20.000µs 📉 -89.2%) vs baseline: -1.0%

Memory: ✅ 34.878MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +5.2%

✅ 1-gauge-metrics-100-times

Time: ✅ 135.772µs (SLO: <150.000µs -9.5%) vs baseline: -0.7%

Memory: ✅ 34.839MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +5.0%

✅ 1-rate-metric-1-times

Time: ✅ 3.110µs (SLO: <20.000µs 📉 -84.5%) vs baseline: -0.1%

Memory: ✅ 34.839MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +5.0%

✅ 1-rate-metrics-100-times

Time: ✅ 213.489µs (SLO: <250.000µs 📉 -14.6%) vs baseline: +1.0%

Memory: ✅ 34.839MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +4.9%

✅ 100-count-metrics-100-times

Time: ✅ 20.007ms (SLO: <22.000ms -9.1%) vs baseline: -0.9%

Memory: ✅ 34.819MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +4.5%

✅ 100-distribution-metrics-100-times

Time: ✅ 2.243ms (SLO: <2.550ms 📉 -12.1%) vs baseline: -0.3%

Memory: ✅ 34.741MB (SLO: <35.500MB -2.1%) vs baseline: +4.4%

✅ 100-gauge-metrics-100-times

Time: ✅ 1.394ms (SLO: <1.550ms 📉 -10.0%) vs baseline: -0.5%

Memory: ✅ 34.741MB (SLO: <35.500MB -2.1%) vs baseline: +4.3%

✅ 100-rate-metrics-100-times

Time: ✅ 2.186ms (SLO: <2.550ms 📉 -14.3%) vs baseline: +0.7%

Memory: ✅ 34.918MB (SLO: <35.500MB 🟡 -1.6%) vs baseline: +4.9%

✅ flush-1-metric

Time: ✅ 4.557µs (SLO: <20.000µs 📉 -77.2%) vs baseline: +0.3%

Memory: ✅ 35.154MB (SLO: <35.500MB 🟡 -1.0%) vs baseline: +4.5%

✅ flush-100-metrics

Time: ✅ 174.840µs (SLO: <250.000µs 📉 -30.1%) vs baseline: -0.5%

Memory: ✅ 35.212MB (SLO: <35.500MB 🟡 -0.8%) vs baseline: +4.4%

✅ flush-1000-metrics

Time: ✅ 2.171ms (SLO: <2.500ms 📉 -13.1%) vs baseline: -0.9%

Memory: ✅ 36.117MB (SLO: <36.500MB 🟡 -1.0%) vs baseline: +5.0%

🟡 Near SLO Breach (16 suites)
🟡 coreapiscenario - 10/10 (1 unstable)

⚠️ context_with_data_listeners

Time: ⚠️ 13.223µs (SLO: <20.000µs 📉 -33.9%) vs baseline: -0.6%

Memory: ✅ 34.918MB (SLO: <35.500MB 🟡 -1.6%) vs baseline: +5.0%

✅ context_with_data_no_listeners

Time: ✅ 3.262µs (SLO: <10.000µs 📉 -67.4%) vs baseline: ~same

Memory: ✅ 34.780MB (SLO: <35.500MB -2.0%) vs baseline: +4.6%

✅ get_item_exists

Time: ✅ 0.578µs (SLO: <10.000µs 📉 -94.2%) vs baseline: -0.6%

Memory: ✅ 34.918MB (SLO: <35.500MB 🟡 -1.6%) vs baseline: +5.3%

✅ get_item_missing

Time: ✅ 0.639µs (SLO: <10.000µs 📉 -93.6%) vs baseline: +1.3%

Memory: ✅ 34.898MB (SLO: <35.500MB 🟡 -1.7%) vs baseline: +4.9%

✅ set_item

Time: ✅ 24.098µs (SLO: <30.000µs 📉 -19.7%) vs baseline: +0.1%

Memory: ✅ 34.957MB (SLO: <35.500MB 🟡 -1.5%) vs baseline: +4.8%

🟡 djangosimple - 30/30

✅ appsec

Time: ✅ 19.576ms (SLO: <22.300ms 📉 -12.2%) vs baseline: ~same

Memory: ✅ 68.318MB (SLO: <70.500MB -3.1%) vs baseline: +4.8%

✅ exception-replay-enabled

Time: ✅ 1.361ms (SLO: <1.450ms -6.2%) vs baseline: -0.5%

Memory: ✅ 66.316MB (SLO: <67.500MB 🟡 -1.8%) vs baseline: +4.7%

✅ iast

Time: ✅ 19.624ms (SLO: <22.250ms 📉 -11.8%) vs baseline: ~same

Memory: ✅ 68.397MB (SLO: <70.000MB -2.3%) vs baseline: +4.9%

✅ profiler

Time: ✅ 15.342ms (SLO: <16.550ms -7.3%) vs baseline: -0.3%

Memory: ✅ 56.554MB (SLO: <57.500MB 🟡 -1.6%) vs baseline: +4.8%

✅ resource-renaming

Time: ✅ 19.391ms (SLO: <21.750ms 📉 -10.8%) vs baseline: -0.6%

Memory: ✅ 68.439MB (SLO: <70.500MB -2.9%) vs baseline: +4.9%

✅ span-code-origin

Time: ✅ 19.725ms (SLO: <28.200ms 📉 -30.1%) vs baseline: +0.2%

Memory: ✅ 68.139MB (SLO: <71.000MB -4.0%) vs baseline: +4.7%

✅ tracer

Time: ✅ 19.522ms (SLO: <21.750ms 📉 -10.2%) vs baseline: -0.6%

Memory: ✅ 68.376MB (SLO: <70.000MB -2.3%) vs baseline: +4.9%

✅ tracer-and-profiler

Time: ✅ 21.613ms (SLO: <23.500ms -8.0%) vs baseline: -0.3%

Memory: ✅ 69.835MB (SLO: <71.000MB 🟡 -1.6%) vs baseline: +4.9%

✅ tracer-dont-create-db-spans

Time: ✅ 19.577ms (SLO: <21.500ms -8.9%) vs baseline: -0.4%

Memory: ✅ 68.321MB (SLO: <70.000MB -2.4%) vs baseline: +4.9%

✅ tracer-minimal

Time: ✅ 16.752ms (SLO: <17.500ms -4.3%) vs baseline: -0.3%

Memory: ✅ 68.282MB (SLO: <70.000MB -2.5%) vs baseline: +4.7%

✅ tracer-native

Time: ✅ 19.525ms (SLO: <21.750ms 📉 -10.2%) vs baseline: +0.6%

Memory: ✅ 68.400MB (SLO: <72.500MB -5.7%) vs baseline: +4.9%

✅ tracer-no-caches

Time: ✅ 17.966ms (SLO: <19.650ms -8.6%) vs baseline: +0.3%

Memory: ✅ 68.341MB (SLO: <70.000MB -2.4%) vs baseline: +4.7%

✅ tracer-no-databases

Time: ✅ 19.500ms (SLO: <20.100ms -3.0%) vs baseline: ~same

Memory: ✅ 67.948MB (SLO: <70.000MB -2.9%) vs baseline: +4.5%

✅ tracer-no-middleware

Time: ✅ 19.276ms (SLO: <21.500ms 📉 -10.3%) vs baseline: -0.2%

Memory: ✅ 68.341MB (SLO: <70.000MB -2.4%) vs baseline: +4.8%

✅ tracer-no-templates

Time: ✅ 19.339ms (SLO: <22.000ms 📉 -12.1%) vs baseline: -0.1%

Memory: ✅ 68.398MB (SLO: <70.500MB -3.0%) vs baseline: +5.0%

🟡 errortrackingdjangosimple - 6/6

✅ errortracking-enabled-all

Time: ✅ 16.257ms (SLO: <19.850ms 📉 -18.1%) vs baseline: -0.4%

Memory: ✅ 69.861MB (SLO: <70.000MB 🟡 -0.2%) vs baseline: +4.8%

✅ errortracking-enabled-user

Time: ✅ 16.293ms (SLO: <19.400ms 📉 -16.0%) vs baseline: ~same

Memory: ✅ 69.785MB (SLO: <70.000MB 🟡 -0.3%) vs baseline: +4.9%

✅ tracer-enabled

Time: ✅ 16.283ms (SLO: <19.450ms 📉 -16.3%) vs baseline: ~same

Memory: ✅ 69.751MB (SLO: <70.000MB 🟡 -0.4%) vs baseline: +4.8%

🟡 errortrackingflasksqli - 6/6

✅ errortracking-enabled-all

Time: ✅ 2.074ms (SLO: <2.300ms -9.8%) vs baseline: +0.3%

Memory: ✅ 55.876MB (SLO: <56.500MB 🟡 -1.1%) vs baseline: +4.8%

✅ errortracking-enabled-user

Time: ✅ 2.075ms (SLO: <2.250ms -7.8%) vs baseline: -0.1%

Memory: ✅ 55.876MB (SLO: <56.500MB 🟡 -1.1%) vs baseline: +4.7%

✅ tracer-enabled

Time: ✅ 2.068ms (SLO: <2.300ms 📉 -10.1%) vs baseline: +0.2%

Memory: ✅ 55.876MB (SLO: <56.500MB 🟡 -1.1%) vs baseline: +4.8%

🟡 flasksimple - 18/18

✅ appsec-get

Time: ✅ 3.383ms (SLO: <4.750ms 📉 -28.8%) vs baseline: +0.2%

Memory: ✅ 55.811MB (SLO: <66.500MB 📉 -16.1%) vs baseline: +4.9%

✅ appsec-post

Time: ✅ 2.852ms (SLO: <6.750ms 📉 -57.8%) vs baseline: -0.1%

Memory: ✅ 55.830MB (SLO: <66.500MB 📉 -16.0%) vs baseline: +4.8%

✅ appsec-telemetry

Time: ✅ 3.355ms (SLO: <4.750ms 📉 -29.4%) vs baseline: -1.8%

Memory: ✅ 55.899MB (SLO: <66.500MB 📉 -15.9%) vs baseline: +4.9%

✅ debugger

Time: ✅ 1.867ms (SLO: <2.000ms -6.7%) vs baseline: ~same

Memory: ✅ 47.780MB (SLO: <49.500MB -3.5%) vs baseline: +4.8%

✅ iast-get

Time: ✅ 1.861ms (SLO: <2.000ms -6.9%) vs baseline: +0.1%

Memory: ✅ 44.872MB (SLO: <49.000MB -8.4%) vs baseline: +4.9%

✅ profiler

Time: ✅ 1.906ms (SLO: <2.100ms -9.2%) vs baseline: ~same

Memory: ✅ 48.824MB (SLO: <50.000MB -2.4%) vs baseline: +4.9%

✅ resource-renaming

Time: ✅ 3.372ms (SLO: <3.650ms -7.6%) vs baseline: +0.3%

Memory: ✅ 55.843MB (SLO: <56.000MB 🟡 -0.3%) vs baseline: +4.7%

✅ tracer

Time: ✅ 3.374ms (SLO: <3.650ms -7.6%) vs baseline: +0.1%

Memory: ✅ 55.818MB (SLO: <56.500MB 🟡 -1.2%) vs baseline: +4.7%

✅ tracer-native

Time: ✅ 3.364ms (SLO: <3.650ms -7.8%) vs baseline: -0.2%

Memory: ✅ 55.798MB (SLO: <60.000MB -7.0%) vs baseline: +4.6%

🟡 flasksqli - 6/6

✅ appsec-enabled

Time: ✅ 2.068ms (SLO: <4.200ms 📉 -50.8%) vs baseline: ~same

Memory: ✅ 55.896MB (SLO: <66.000MB 📉 -15.3%) vs baseline: +4.9%

✅ iast-enabled

Time: ✅ 2.068ms (SLO: <2.800ms 📉 -26.1%) vs baseline: ~same

Memory: ✅ 55.896MB (SLO: <62.500MB 📉 -10.6%) vs baseline: +4.9%

✅ tracer-enabled

Time: ✅ 2.060ms (SLO: <2.250ms -8.5%) vs baseline: +0.2%

Memory: ✅ 55.896MB (SLO: <56.500MB 🟡 -1.1%) vs baseline: +4.8%

🟡 httppropagationextract - 60/60

✅ all_styles_all_headers

Time: ✅ 81.000µs (SLO: <100.000µs 📉 -19.0%) vs baseline: -0.8%

Memory: ✅ 34.819MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +4.3%

✅ b3_headers

Time: ✅ 14.358µs (SLO: <20.000µs 📉 -28.2%) vs baseline: -0.4%

Memory: ✅ 34.898MB (SLO: <35.500MB 🟡 -1.7%) vs baseline: +5.0%

✅ b3_single_headers

Time: ✅ 13.416µs (SLO: <20.000µs 📉 -32.9%) vs baseline: -0.5%

Memory: ✅ 34.996MB (SLO: <35.500MB 🟡 -1.4%) vs baseline: +5.0%

✅ datadog_tracecontext_tracestate_not_propagated_on_trace_id_no_match

Time: ✅ 63.837µs (SLO: <80.000µs 📉 -20.2%) vs baseline: -0.1%

Memory: ✅ 35.016MB (SLO: <35.500MB 🟡 -1.4%) vs baseline: +4.9%

✅ datadog_tracecontext_tracestate_propagated_on_trace_id_match

Time: ✅ 65.966µs (SLO: <80.000µs 📉 -17.5%) vs baseline: -0.5%

Memory: ✅ 34.937MB (SLO: <35.500MB 🟡 -1.6%) vs baseline: +4.9%

✅ empty_headers

Time: ✅ 1.614µs (SLO: <10.000µs 📉 -83.9%) vs baseline: +0.2%

Memory: ✅ 34.977MB (SLO: <35.500MB 🟡 -1.5%) vs baseline: +5.0%

✅ full_t_id_datadog_headers

Time: ✅ 22.724µs (SLO: <30.000µs 📉 -24.3%) vs baseline: -0.3%

Memory: ✅ 34.918MB (SLO: <35.500MB 🟡 -1.6%) vs baseline: +4.3%

✅ invalid_priority_header

Time: ✅ 6.494µs (SLO: <10.000µs 📉 -35.1%) vs baseline: -0.3%

Memory: ✅ 34.957MB (SLO: <35.500MB 🟡 -1.5%) vs baseline: +5.0%

✅ invalid_span_id_header

Time: ✅ 6.513µs (SLO: <10.000µs 📉 -34.9%) vs baseline: +0.6%

Memory: ✅ 35.036MB (SLO: <35.500MB 🟡 -1.3%) vs baseline: +5.2%

✅ invalid_tags_header

Time: ✅ 6.492µs (SLO: <10.000µs 📉 -35.1%) vs baseline: +0.3%

Memory: ✅ 34.937MB (SLO: <35.500MB 🟡 -1.6%) vs baseline: +4.7%

✅ invalid_trace_id_header

Time: ✅ 6.509µs (SLO: <10.000µs 📉 -34.9%) vs baseline: -0.5%

Memory: ✅ 34.957MB (SLO: <35.500MB 🟡 -1.5%) vs baseline: +4.8%

✅ large_header_no_matches

Time: ✅ 27.561µs (SLO: <30.000µs -8.1%) vs baseline: -0.2%

Memory: ✅ 34.957MB (SLO: <35.500MB 🟡 -1.5%) vs baseline: +4.9%

✅ large_valid_headers_all

Time: ✅ 28.585µs (SLO: <40.000µs 📉 -28.5%) vs baseline: +0.2%

Memory: ✅ 34.918MB (SLO: <35.500MB 🟡 -1.6%) vs baseline: +4.7%

✅ medium_header_no_matches

Time: ✅ 9.837µs (SLO: <20.000µs 📉 -50.8%) vs baseline: +0.4%

Memory: ✅ 34.937MB (SLO: <35.500MB 🟡 -1.6%) vs baseline: +4.5%

✅ medium_valid_headers_all

Time: ✅ 11.246µs (SLO: <20.000µs 📉 -43.8%) vs baseline: -0.4%

Memory: ✅ 34.898MB (SLO: <35.500MB 🟡 -1.7%) vs baseline: +4.5%

✅ none_propagation_style

Time: ✅ 1.724µs (SLO: <10.000µs 📉 -82.8%) vs baseline: +0.8%

Memory: ✅ 34.937MB (SLO: <35.500MB 🟡 -1.6%) vs baseline: +4.8%

✅ tracecontext_headers

Time: ✅ 34.669µs (SLO: <40.000µs 📉 -13.3%) vs baseline: -0.6%

Memory: ✅ 34.878MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +4.6%

✅ valid_headers_all

Time: ✅ 6.499µs (SLO: <10.000µs 📉 -35.0%) vs baseline: -0.2%

Memory: ✅ 34.898MB (SLO: <35.500MB 🟡 -1.7%) vs baseline: +4.7%

✅ valid_headers_basic

Time: ✅ 6.037µs (SLO: <10.000µs 📉 -39.6%) vs baseline: -0.7%

Memory: ✅ 34.957MB (SLO: <35.500MB 🟡 -1.5%) vs baseline: +4.7%

✅ wsgi_empty_headers

Time: ✅ 1.596µs (SLO: <10.000µs 📉 -84.0%) vs baseline: ~same

Memory: ✅ 34.977MB (SLO: <35.500MB 🟡 -1.5%) vs baseline: +4.9%

✅ wsgi_invalid_priority_header

Time: ✅ 6.575µs (SLO: <10.000µs 📉 -34.3%) vs baseline: +0.4%

Memory: ✅ 34.937MB (SLO: <35.500MB 🟡 -1.6%) vs baseline: +4.9%

✅ wsgi_invalid_span_id_header

Time: ✅ 1.597µs (SLO: <10.000µs 📉 -84.0%) vs baseline: +0.6%

Memory: ✅ 34.977MB (SLO: <35.500MB 🟡 -1.5%) vs baseline: +4.9%

✅ wsgi_invalid_tags_header

Time: ✅ 6.549µs (SLO: <10.000µs 📉 -34.5%) vs baseline: -0.4%

Memory: ✅ 35.016MB (SLO: <35.500MB 🟡 -1.4%) vs baseline: +5.2%

✅ wsgi_invalid_trace_id_header

Time: ✅ 6.697µs (SLO: <10.000µs 📉 -33.0%) vs baseline: +1.9%

Memory: ✅ 34.996MB (SLO: <35.500MB 🟡 -1.4%) vs baseline: +4.9%

✅ wsgi_large_header_no_matches

Time: ✅ 28.657µs (SLO: <40.000µs 📉 -28.4%) vs baseline: +0.1%

Memory: ✅ 35.154MB (SLO: <35.500MB 🟡 -1.0%) vs baseline: +4.4%

✅ wsgi_large_valid_headers_all

Time: ✅ 29.826µs (SLO: <40.000µs 📉 -25.4%) vs baseline: +0.1%

Memory: ✅ 35.311MB (SLO: <35.500MB 🟡 -0.5%) vs baseline: +5.6%

✅ wsgi_medium_header_no_matches

Time: ✅ 10.215µs (SLO: <20.000µs 📉 -48.9%) vs baseline: +1.3%

Memory: ✅ 35.036MB (SLO: <35.500MB 🟡 -1.3%) vs baseline: +5.2%

✅ wsgi_medium_valid_headers_all

Time: ✅ 11.706µs (SLO: <20.000µs 📉 -41.5%) vs baseline: +0.5%

Memory: ✅ 34.819MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +4.4%

✅ wsgi_valid_headers_all

Time: ✅ 6.591µs (SLO: <10.000µs 📉 -34.1%) vs baseline: +0.2%

Memory: ✅ 34.859MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +4.7%

✅ wsgi_valid_headers_basic

Time: ✅ 6.086µs (SLO: <10.000µs 📉 -39.1%) vs baseline: +0.1%

Memory: ✅ 34.957MB (SLO: <35.500MB 🟡 -1.5%) vs baseline: +4.6%

🟡 httppropagationinject - 16/16

✅ ids_only

Time: ✅ 21.997µs (SLO: <30.000µs 📉 -26.7%) vs baseline: +4.8%

Memory: ✅ 35.016MB (SLO: <35.500MB 🟡 -1.4%) vs baseline: +4.9%

✅ with_all

Time: ✅ 27.674µs (SLO: <40.000µs 📉 -30.8%) vs baseline: -0.4%

Memory: ✅ 34.957MB (SLO: <35.500MB 🟡 -1.5%) vs baseline: +5.5%

✅ with_dd_origin

Time: ✅ 24.718µs (SLO: <30.000µs 📉 -17.6%) vs baseline: +0.1%

Memory: ✅ 34.977MB (SLO: <35.500MB 🟡 -1.5%) vs baseline: +5.0%

✅ with_priority_and_origin

Time: ✅ 24.045µs (SLO: <40.000µs 📉 -39.9%) vs baseline: -0.1%

Memory: ✅ 34.878MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +4.6%

✅ with_sampling_priority

Time: ✅ 20.779µs (SLO: <30.000µs 📉 -30.7%) vs baseline: -0.2%

Memory: ✅ 34.918MB (SLO: <35.500MB 🟡 -1.6%) vs baseline: +4.9%

✅ with_tags

Time: ✅ 25.920µs (SLO: <40.000µs 📉 -35.2%) vs baseline: ~same

Memory: ✅ 34.859MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +4.6%

✅ with_tags_invalid

Time: ✅ 27.365µs (SLO: <40.000µs 📉 -31.6%) vs baseline: -0.8%

Memory: ✅ 34.918MB (SLO: <35.500MB 🟡 -1.6%) vs baseline: +4.9%

✅ with_tags_max_size

Time: ✅ 26.284µs (SLO: <40.000µs 📉 -34.3%) vs baseline: -0.8%

Memory: ✅ 34.839MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +4.9%

🟡 iastaspectssplit - 12/12

✅ rsplit_aspect

Time: ✅ 1.600µs (SLO: <10.000µs 📉 -84.0%) vs baseline: +4.5%

Memory: ✅ 42.684MB (SLO: <43.500MB 🟡 -1.9%) vs baseline: +5.0%

✅ rsplit_noaspect

Time: ✅ 1.645µs (SLO: <10.000µs 📉 -83.6%) vs baseline: +1.7%

Memory: ✅ 42.684MB (SLO: <43.500MB 🟡 -1.9%) vs baseline: +5.2%

✅ split_aspect

Time: ✅ 1.558µs (SLO: <10.000µs 📉 -84.4%) vs baseline: +0.9%

Memory: ✅ 42.605MB (SLO: <43.500MB -2.1%) vs baseline: +5.1%

✅ split_noaspect

Time: ✅ 1.626µs (SLO: <10.000µs 📉 -83.7%) vs baseline: -1.2%

Memory: ✅ 42.546MB (SLO: <43.500MB -2.2%) vs baseline: +4.6%

✅ splitlines_aspect

Time: ✅ 1.504µs (SLO: <10.000µs 📉 -85.0%) vs baseline: ~same

Memory: ✅ 42.605MB (SLO: <43.500MB -2.1%) vs baseline: +5.0%

✅ splitlines_noaspect

Time: ✅ 1.562µs (SLO: <10.000µs 📉 -84.4%) vs baseline: +1.1%

Memory: ✅ 42.566MB (SLO: <43.500MB -2.1%) vs baseline: +5.0%

🟡 otelspan - 22/22

✅ add-event

Time: ✅ 40.045ms (SLO: <47.150ms 📉 -15.1%) vs baseline: +0.2%

Memory: ✅ 39.476MB (SLO: <47.000MB 📉 -16.0%) vs baseline: +4.9%

✅ add-metrics

Time: ✅ 258.246ms (SLO: <344.800ms 📉 -25.1%) vs baseline: -1.1%

Memory: ✅ 43.695MB (SLO: <47.500MB -8.0%) vs baseline: +5.0%

✅ add-tags

Time: ✅ 318.529ms (SLO: <321.000ms 🟡 -0.8%) vs baseline: -0.1%

Memory: ✅ 43.654MB (SLO: <47.500MB -8.1%) vs baseline: +4.4%

✅ get-context

Time: ✅ 80.384ms (SLO: <92.350ms 📉 -13.0%) vs baseline: -0.1%

Memory: ✅ 39.901MB (SLO: <46.500MB 📉 -14.2%) vs baseline: +5.0%

✅ is-recording

Time: ✅ 37.879ms (SLO: <44.500ms 📉 -14.9%) vs baseline: +0.6%

Memory: ✅ 39.340MB (SLO: <47.500MB 📉 -17.2%) vs baseline: +4.2%

✅ record-exception

Time: ✅ 58.609ms (SLO: <67.650ms 📉 -13.4%) vs baseline: -0.6%

Memory: ✅ 39.929MB (SLO: <47.000MB 📉 -15.0%) vs baseline: +4.5%

✅ set-status

Time: ✅ 44.208ms (SLO: <50.400ms 📉 -12.3%) vs baseline: +0.2%

Memory: ✅ 39.412MB (SLO: <47.000MB 📉 -16.1%) vs baseline: +5.0%

✅ start

Time: ✅ 37.862ms (SLO: <43.450ms 📉 -12.9%) vs baseline: +2.4%

Memory: ✅ 39.478MB (SLO: <47.000MB 📉 -16.0%) vs baseline: +4.9%

✅ start-finish

Time: ✅ 82.394ms (SLO: <88.000ms -6.4%) vs baseline: ~same

Memory: ✅ 37.395MB (SLO: <46.500MB 📉 -19.6%) vs baseline: +5.1%

✅ start-finish-telemetry

Time: ✅ 84.265ms (SLO: <89.000ms -5.3%) vs baseline: +0.4%

Memory: ✅ 37.356MB (SLO: <46.500MB 📉 -19.7%) vs baseline: +4.8%

✅ update-name

Time: ✅ 38.563ms (SLO: <45.150ms 📉 -14.6%) vs baseline: ~same

Memory: ✅ 39.574MB (SLO: <47.000MB 📉 -15.8%) vs baseline: +4.6%

🟡 ratelimiter - 12/12

✅ defaults

Time: ✅ 2.344µs (SLO: <10.000µs 📉 -76.6%) vs baseline: -0.2%

Memory: ✅ 35.095MB (SLO: <35.500MB 🟡 -1.1%) vs baseline: +4.8%

✅ high_rate_limit

Time: ✅ 2.395µs (SLO: <10.000µs 📉 -76.1%) vs baseline: -0.2%

Memory: ✅ 35.154MB (SLO: <35.500MB 🟡 -1.0%) vs baseline: +4.7%

✅ long_window

Time: ✅ 2.350µs (SLO: <10.000µs 📉 -76.5%) vs baseline: -0.9%

Memory: ✅ 35.055MB (SLO: <35.500MB 🟡 -1.3%) vs baseline: +4.7%

✅ low_rate_limit

Time: ✅ 2.346µs (SLO: <10.000µs 📉 -76.5%) vs baseline: -0.7%

Memory: ✅ 35.193MB (SLO: <35.500MB 🟡 -0.9%) vs baseline: +5.2%

✅ no_rate_limit

Time: ✅ 0.825µs (SLO: <10.000µs 📉 -91.7%) vs baseline: ~same

Memory: ✅ 35.173MB (SLO: <35.500MB 🟡 -0.9%) vs baseline: +4.7%

✅ short_window

Time: ✅ 2.485µs (SLO: <10.000µs 📉 -75.2%) vs baseline: -0.6%

Memory: ✅ 35.154MB (SLO: <35.500MB 🟡 -1.0%) vs baseline: +4.7%

🟡 recursivecomputation - 8/8

✅ deep

Time: ✅ 307.922ms (SLO: <320.950ms -4.1%) vs baseline: -0.5%

Memory: ✅ 36.058MB (SLO: <36.500MB 🟡 -1.2%) vs baseline: +5.0%

✅ deep-profiled

Time: ✅ 325.471ms (SLO: <359.150ms -9.4%) vs baseline: +0.1%

Memory: ✅ 40.049MB (SLO: <40.500MB 🟡 -1.1%) vs baseline: +5.1%

✅ medium

Time: ✅ 6.996ms (SLO: <7.400ms -5.5%) vs baseline: -0.2%

Memory: ✅ 34.760MB (SLO: <35.500MB -2.1%) vs baseline: +4.4%

✅ shallow

Time: ✅ 0.945ms (SLO: <1.050ms 📉 -10.0%) vs baseline: +0.6%

Memory: ✅ 34.780MB (SLO: <35.500MB -2.0%) vs baseline: +4.5%

🟡 samplingrules - 8/8

✅ average_match

Time: ✅ 137.289µs (SLO: <290.000µs 📉 -52.7%) vs baseline: +0.4%

Memory: ✅ 34.957MB (SLO: <35.500MB 🟡 -1.5%) vs baseline: +5.2%

✅ high_match

Time: ✅ 173.895µs (SLO: <480.000µs 📉 -63.8%) vs baseline: +0.4%

Memory: ✅ 34.839MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +4.9%

✅ low_match

Time: ✅ 98.839µs (SLO: <120.000µs 📉 -17.6%) vs baseline: ~same

Memory: ✅ 603.674MB (SLO: <700.000MB 📉 -13.8%) vs baseline: +4.9%

✅ very_low_match

Time: ✅ 2.665ms (SLO: <8.500ms 📉 -68.6%) vs baseline: -0.2%

Memory: ✅ 71.072MB (SLO: <75.000MB -5.2%) vs baseline: +4.7%

🟡 sethttpmeta - 32/32

✅ all-disabled

Time: ✅ 10.529µs (SLO: <20.000µs 📉 -47.4%) vs baseline: +0.2%

Memory: ✅ 35.704MB (SLO: <36.000MB 🟡 -0.8%) vs baseline: +4.9%

✅ all-enabled

Time: ✅ 40.894µs (SLO: <50.000µs 📉 -18.2%) vs baseline: +2.3%

Memory: ✅ 35.704MB (SLO: <36.000MB 🟡 -0.8%) vs baseline: +4.6%

✅ collectipvariant_exists

Time: ✅ 40.996µs (SLO: <50.000µs 📉 -18.0%) vs baseline: +0.2%

Memory: ✅ 35.665MB (SLO: <36.000MB 🟡 -0.9%) vs baseline: +4.6%

✅ no-collectipvariant

Time: ✅ 40.075µs (SLO: <50.000µs 📉 -19.9%) vs baseline: +0.5%

Memory: ✅ 35.684MB (SLO: <36.000MB 🟡 -0.9%) vs baseline: +4.7%

✅ no-useragentvariant

Time: ✅ 38.730µs (SLO: <50.000µs 📉 -22.5%) vs baseline: +0.2%

Memory: ✅ 35.724MB (SLO: <36.000MB 🟡 -0.8%) vs baseline: +4.9%

✅ obfuscation-no-query

Time: ✅ 40.536µs (SLO: <50.000µs 📉 -18.9%) vs baseline: -0.2%

Memory: ✅ 35.645MB (SLO: <36.000MB 🟡 -1.0%) vs baseline: +4.5%

✅ obfuscation-regular-case-explicit-query

Time: ✅ 75.878µs (SLO: <90.000µs 📉 -15.7%) vs baseline: -0.3%

Memory: ✅ 35.743MB (SLO: <36.500MB -2.1%) vs baseline: +5.2%

✅ obfuscation-regular-case-implicit-query

Time: ✅ 76.422µs (SLO: <90.000µs 📉 -15.1%) vs baseline: -0.2%

Memory: ✅ 35.743MB (SLO: <36.500MB -2.1%) vs baseline: +5.1%

✅ obfuscation-send-querystring-disabled

Time: ✅ 153.982µs (SLO: <170.000µs -9.4%) vs baseline: -0.4%

Memory: ✅ 35.724MB (SLO: <36.500MB -2.1%) vs baseline: +4.9%

✅ obfuscation-worst-case-explicit-query

Time: ✅ 148.211µs (SLO: <160.000µs -7.4%) vs baseline: -0.4%

Memory: ✅ 35.822MB (SLO: <36.500MB 🟡 -1.9%) vs baseline: +5.3%

✅ obfuscation-worst-case-implicit-query

Time: ✅ 154.692µs (SLO: <170.000µs -9.0%) vs baseline: -0.3%

Memory: ✅ 35.684MB (SLO: <36.500MB -2.2%) vs baseline: +4.8%

✅ useragentvariant_exists_1

Time: ✅ 39.504µs (SLO: <50.000µs 📉 -21.0%) vs baseline: +0.1%

Memory: ✅ 35.704MB (SLO: <36.000MB 🟡 -0.8%) vs baseline: +5.1%

✅ useragentvariant_exists_2

Time: ✅ 40.647µs (SLO: <50.000µs 📉 -18.7%) vs baseline: ~same

Memory: ✅ 35.645MB (SLO: <36.000MB 🟡 -1.0%) vs baseline: +4.8%

✅ useragentvariant_exists_3

Time: ✅ 40.124µs (SLO: <50.000µs 📉 -19.8%) vs baseline: +0.5%

Memory: ✅ 35.665MB (SLO: <36.000MB 🟡 -0.9%) vs baseline: +4.7%

✅ useragentvariant_not_exists_1

Time: ✅ 39.462µs (SLO: <50.000µs 📉 -21.1%) vs baseline: ~same

Memory: ✅ 35.625MB (SLO: <36.000MB 🟡 -1.0%) vs baseline: +4.9%

✅ useragentvariant_not_exists_2

Time: ✅ 39.445µs (SLO: <50.000µs 📉 -21.1%) vs baseline: ~same

Memory: ✅ 35.724MB (SLO: <36.000MB 🟡 -0.8%) vs baseline: +4.9%

🟡 span - 26/26

✅ add-event

Time: ✅ 18.242ms (SLO: <22.500ms 📉 -18.9%) vs baseline: +0.2%

Memory: ✅ 36.915MB (SLO: <53.000MB 📉 -30.3%) vs baseline: +4.9%

✅ add-metrics

Time: ✅ 88.244ms (SLO: <93.500ms -5.6%) vs baseline: +0.9%

Memory: ✅ 41.190MB (SLO: <53.000MB 📉 -22.3%) vs baseline: +4.8%

✅ add-tags

Time: ✅ 142.373ms (SLO: <155.000ms -8.1%) vs baseline: +0.6%

Memory: ✅ 41.160MB (SLO: <53.000MB 📉 -22.3%) vs baseline: +4.9%

✅ get-context

Time: ✅ 16.941ms (SLO: <20.500ms 📉 -17.4%) vs baseline: -0.2%

Memory: ✅ 36.737MB (SLO: <53.000MB 📉 -30.7%) vs baseline: +4.5%

✅ is-recording

Time: ✅ 17.285ms (SLO: <20.500ms 📉 -15.7%) vs baseline: +0.2%

Memory: ✅ 36.777MB (SLO: <53.000MB 📉 -30.6%) vs baseline: +4.8%

✅ record-exception

Time: ✅ 36.552ms (SLO: <40.000ms -8.6%) vs baseline: +0.4%

Memory: ✅ 37.433MB (SLO: <53.000MB 📉 -29.4%) vs baseline: +5.3%

✅ set-status

Time: ✅ 18.775ms (SLO: <22.000ms 📉 -14.7%) vs baseline: +0.7%

Memory: ✅ 36.757MB (SLO: <53.000MB 📉 -30.6%) vs baseline: +4.6%

✅ start

Time: ✅ 17.319ms (SLO: <20.500ms 📉 -15.5%) vs baseline: +2.4%

Memory: ✅ 36.727MB (SLO: <53.000MB 📉 -30.7%) vs baseline: +4.7%

✅ start-finish

Time: ✅ 50.923ms (SLO: <52.500ms -3.0%) vs baseline: -1.0%

Memory: ✅ 34.878MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +5.0%

✅ start-finish-telemetry

Time: ✅ 52.182ms (SLO: <54.500ms -4.3%) vs baseline: +0.5%

Memory: ✅ 34.977MB (SLO: <35.500MB 🟡 -1.5%) vs baseline: +5.2%

✅ start-finish-traceid128

Time: ✅ 54.169ms (SLO: <57.000ms -5.0%) vs baseline: +0.1%

Memory: ✅ 34.800MB (SLO: <35.500MB 🟡 -2.0%) vs baseline: +4.8%

✅ start-traceid128

Time: ✅ 17.310ms (SLO: <22.500ms 📉 -23.1%) vs baseline: +0.3%

Memory: ✅ 36.868MB (SLO: <53.000MB 📉 -30.4%) vs baseline: +4.9%

✅ update-name

Time: ✅ 17.355ms (SLO: <22.000ms 📉 -21.1%) vs baseline: +0.9%

Memory: ✅ 36.833MB (SLO: <53.000MB 📉 -30.5%) vs baseline: +4.5%

🟡 tracer - 6/6

✅ large

Time: ✅ 29.120ms (SLO: <32.950ms 📉 -11.6%) vs baseline: +0.5%

Memory: ✅ 36.117MB (SLO: <36.500MB 🟡 -1.0%) vs baseline: +5.2%

✅ medium

Time: ✅ 2.872ms (SLO: <3.200ms 📉 -10.3%) vs baseline: -0.3%

Memory: ✅ 34.780MB (SLO: <35.500MB -2.0%) vs baseline: +4.7%

✅ small

Time: ✅ 330.127µs (SLO: <370.000µs 📉 -10.8%) vs baseline: +0.8%

Memory: ✅ 34.859MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +4.7%

⚠️ Unstable Tests (1 suite)
⚠️ packagesupdateimporteddependencies - 24/24 (1 unstable)

✅ import_many

Time: ✅ 154.915µs (SLO: <170.000µs -8.9%) vs baseline: ~same

Memory: ✅ 40.034MB (SLO: <43.000MB -6.9%) vs baseline: +4.1%

✅ import_many_cached

Time: ✅ 120.599µs (SLO: <130.000µs -7.2%) vs baseline: -1.1%

Memory: ✅ 39.802MB (SLO: <43.000MB -7.4%) vs baseline: +4.5%

✅ import_many_stdlib

Time: ✅ 0.755ms (SLO: <1.750ms 📉 -56.9%) vs baseline: -0.6%

Memory: ✅ 39.770MB (SLO: <43.000MB -7.5%) vs baseline: +4.1%

⚠️ import_many_stdlib_cached

Time: ⚠️ 0.172ms (SLO: <1.100ms 📉 -84.3%) vs baseline: -0.6%

Memory: ✅ 39.596MB (SLO: <43.000MB -7.9%) vs baseline: +4.6%

✅ import_many_unknown

Time: ✅ 831.301µs (SLO: <890.000µs -6.6%) vs baseline: -0.7%

Memory: ✅ 39.847MB (SLO: <43.000MB -7.3%) vs baseline: +4.6%

✅ import_many_unknown_cached

Time: ✅ 797.263µs (SLO: <870.000µs -8.4%) vs baseline: -0.4%

Memory: ✅ 39.830MB (SLO: <43.000MB -7.4%) vs baseline: +5.1%

✅ import_one

Time: ✅ 19.749µs (SLO: <30.000µs 📉 -34.2%) vs baseline: +0.4%

Memory: ✅ 39.815MB (SLO: <43.000MB -7.4%) vs baseline: +4.6%

✅ import_one_cache

Time: ✅ 6.281µs (SLO: <10.000µs 📉 -37.2%) vs baseline: +0.2%

Memory: ✅ 39.732MB (SLO: <43.000MB -7.6%) vs baseline: +3.8%

✅ import_one_stdlib

Time: ✅ 18.718µs (SLO: <20.000µs -6.4%) vs baseline: +0.3%

Memory: ✅ 39.722MB (SLO: <43.000MB -7.6%) vs baseline: +3.8%

✅ import_one_stdlib_cache

Time: ✅ 6.234µs (SLO: <10.000µs 📉 -37.7%) vs baseline: -0.8%

Memory: ✅ 39.610MB (SLO: <43.000MB -7.9%) vs baseline: +4.5%

✅ import_one_unknown

Time: ✅ 45.242µs (SLO: <50.000µs -9.5%) vs baseline: -1.0%

Memory: ✅ 39.733MB (SLO: <43.000MB -7.6%) vs baseline: +4.2%

✅ import_one_unknown_cache

Time: ✅ 6.256µs (SLO: <10.000µs 📉 -37.4%) vs baseline: -1.3%

Memory: ✅ 39.803MB (SLO: <43.000MB -7.4%) vs baseline: +4.7%

✅ All Tests Passing (4 suites)
✅ iast_aspects - 40/40

✅ re_expand_aspect

Time: ✅ 37.650µs (SLO: <40.000µs -5.9%) vs baseline: +6.7%

Memory: ✅ 42.330MB (SLO: <43.500MB -2.7%) vs baseline: +4.9%

✅ re_expand_noaspect

Time: ✅ 35.026µs (SLO: <40.000µs 📉 -12.4%) vs baseline: +0.3%

Memory: ✅ 42.153MB (SLO: <43.500MB -3.1%) vs baseline: +4.4%

✅ re_findall_aspect

Time: ✅ 3.431µs (SLO: <10.000µs 📉 -65.7%) vs baseline: +0.3%

Memory: ✅ 42.231MB (SLO: <43.500MB -2.9%) vs baseline: +5.0%

✅ re_findall_noaspect

Time: ✅ 3.246µs (SLO: <10.000µs 📉 -67.5%) vs baseline: -0.5%

Memory: ✅ 42.113MB (SLO: <43.500MB -3.2%) vs baseline: +4.4%

✅ re_finditer_aspect

Time: ✅ 4.564µs (SLO: <10.000µs 📉 -54.4%) vs baseline: -0.1%

Memory: ✅ 42.290MB (SLO: <43.500MB -2.8%) vs baseline: +4.7%

✅ re_finditer_noaspect

Time: ✅ 3.325µs (SLO: <10.000µs 📉 -66.8%) vs baseline: -0.5%

Memory: ✅ 42.330MB (SLO: <43.500MB -2.7%) vs baseline: +4.9%

✅ re_fullmatch_aspect

Time: ✅ 2.798µs (SLO: <10.000µs 📉 -72.0%) vs baseline: +0.4%

Memory: ✅ 42.408MB (SLO: <43.500MB -2.5%) vs baseline: +5.0%

✅ re_fullmatch_noaspect

Time: ✅ 3.080µs (SLO: <10.000µs 📉 -69.2%) vs baseline: -0.6%

Memory: ✅ 42.271MB (SLO: <43.500MB -2.8%) vs baseline: +5.2%

✅ re_group_aspect

Time: ✅ 4.829µs (SLO: <10.000µs 📉 -51.7%) vs baseline: ~same

Memory: ✅ 42.212MB (SLO: <43.500MB -3.0%) vs baseline: +5.0%

✅ re_group_noaspect

Time: ✅ 4.905µs (SLO: <10.000µs 📉 -51.0%) vs baseline: +0.3%

Memory: ✅ 42.172MB (SLO: <43.500MB -3.1%) vs baseline: +4.7%

✅ re_groups_aspect

Time: ✅ 4.978µs (SLO: <10.000µs 📉 -50.2%) vs baseline: +0.7%

Memory: ✅ 42.389MB (SLO: <43.500MB -2.6%) vs baseline: +5.2%

✅ re_groups_noaspect

Time: ✅ 4.983µs (SLO: <10.000µs 📉 -50.2%) vs baseline: ~same

Memory: ✅ 42.310MB (SLO: <43.500MB -2.7%) vs baseline: +5.1%

✅ re_match_aspect

Time: ✅ 2.823µs (SLO: <10.000µs 📉 -71.8%) vs baseline: ~same

Memory: ✅ 42.330MB (SLO: <43.500MB -2.7%) vs baseline: +4.9%

✅ re_match_noaspect

Time: ✅ 3.098µs (SLO: <10.000µs 📉 -69.0%) vs baseline: -0.4%

Memory: ✅ 42.251MB (SLO: <43.500MB -2.9%) vs baseline: +4.9%

✅ re_search_aspect

Time: ✅ 2.670µs (SLO: <10.000µs 📉 -73.3%) vs baseline: +1.5%

Memory: ✅ 42.310MB (SLO: <43.500MB -2.7%) vs baseline: +4.6%

✅ re_search_noaspect

Time: ✅ 2.905µs (SLO: <10.000µs 📉 -70.9%) vs baseline: -0.6%

Memory: ✅ 42.231MB (SLO: <43.500MB -2.9%) vs baseline: +4.2%

✅ re_sub_aspect

Time: ✅ 3.574µs (SLO: <10.000µs 📉 -64.3%) vs baseline: +0.9%

Memory: ✅ 42.192MB (SLO: <43.500MB -3.0%) vs baseline: +4.4%

✅ re_sub_noaspect

Time: ✅ 3.968µs (SLO: <10.000µs 📉 -60.3%) vs baseline: -0.3%

Memory: ✅ 42.251MB (SLO: <43.500MB -2.9%) vs baseline: +5.1%

✅ re_subn_aspect

Time: ✅ 3.992µs (SLO: <10.000µs 📉 -60.1%) vs baseline: +5.4%

Memory: ✅ 42.310MB (SLO: <43.500MB -2.7%) vs baseline: +5.0%

✅ re_subn_noaspect

Time: ✅ 4.112µs (SLO: <10.000µs 📉 -58.9%) vs baseline: -0.2%

Memory: ✅ 42.290MB (SLO: <43.500MB -2.8%) vs baseline: +4.9%

✅ iastpropagation - 8/8

✅ no-propagation

Time: ✅ 49.230µs (SLO: <60.000µs 📉 -18.0%) vs baseline: +0.3%

Memory: ✅ 38.299MB (SLO: <42.000MB -8.8%) vs baseline: +4.9%

✅ propagation_enabled

Time: ✅ 137.881µs (SLO: <190.000µs 📉 -27.4%) vs baseline: +0.3%

Memory: ✅ 38.299MB (SLO: <42.000MB -8.8%) vs baseline: +4.9%

✅ propagation_enabled_100

Time: ✅ 1.590ms (SLO: <2.300ms 📉 -30.9%) vs baseline: +0.3%

Memory: ✅ 38.437MB (SLO: <42.000MB -8.5%) vs baseline: +5.2%

✅ propagation_enabled_1000

Time: ✅ 29.635ms (SLO: <34.550ms 📉 -14.2%) vs baseline: +0.6%

Memory: ✅ 38.653MB (SLO: <42.000MB -8.0%) vs baseline: +4.9%

✅ otelsdkspan - 24/24

✅ add-event

Time: ✅ 40.606ms (SLO: <42.000ms -3.3%) vs baseline: +0.7%

Memory: ✅ 37.611MB (SLO: <39.000MB -3.6%) vs baseline: +4.6%

✅ add-link

Time: ✅ 36.484ms (SLO: <38.550ms -5.4%) vs baseline: ~same

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.7%

✅ add-metrics

Time: ✅ 221.425ms (SLO: <232.000ms -4.6%) vs baseline: +0.6%

Memory: ✅ 37.808MB (SLO: <39.000MB -3.1%) vs baseline: +5.1%

✅ add-tags

Time: ✅ 212.224ms (SLO: <221.600ms -4.2%) vs baseline: +0.6%

Memory: ✅ 37.611MB (SLO: <39.000MB -3.6%) vs baseline: +4.6%

✅ get-context

Time: ✅ 29.309ms (SLO: <31.300ms -6.4%) vs baseline: +0.5%

Memory: ✅ 37.749MB (SLO: <39.000MB -3.2%) vs baseline: +4.9%

✅ is-recording

Time: ✅ 29.316ms (SLO: <31.000ms -5.4%) vs baseline: +1.0%

Memory: ✅ 37.749MB (SLO: <39.000MB -3.2%) vs baseline: +4.7%

✅ record-exception

Time: ✅ 63.406ms (SLO: <65.850ms -3.7%) vs baseline: +0.5%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.8%

✅ set-status

Time: ✅ 31.923ms (SLO: <34.150ms -6.5%) vs baseline: -0.1%

Memory: ✅ 37.729MB (SLO: <39.000MB -3.3%) vs baseline: +5.0%

✅ start

Time: ✅ 29.371ms (SLO: <30.150ms -2.6%) vs baseline: +1.2%

Memory: ✅ 37.532MB (SLO: <39.000MB -3.8%) vs baseline: +4.4%

✅ start-finish

Time: ✅ 34.005ms (SLO: <35.350ms -3.8%) vs baseline: +0.3%

Memory: ✅ 37.788MB (SLO: <39.000MB -3.1%) vs baseline: +5.0%

✅ start-finish-telemetry

Time: ✅ 34.047ms (SLO: <35.450ms -4.0%) vs baseline: +0.3%

Memory: ✅ 37.532MB (SLO: <39.000MB -3.8%) vs baseline: +4.3%

✅ update-name

Time: ✅ 31.264ms (SLO: <33.400ms -6.4%) vs baseline: +0.9%

Memory: ✅ 37.808MB (SLO: <39.000MB -3.1%) vs baseline: +4.9%

✅ packagespackageforrootmodulemapping - 4/4

✅ cache_off

Time: ✅ 342.664ms (SLO: <354.300ms -3.3%) vs baseline: -1.0%

Memory: ✅ 40.905MB (SLO: <43.500MB -6.0%) vs baseline: +5.4%

✅ cache_on

Time: ✅ 0.385µs (SLO: <10.000µs 📉 -96.2%) vs baseline: +0.5%

Memory: ✅ 40.317MB (SLO: <43.000MB -6.2%) vs baseline: +4.9%

ℹ️ Scenarios Missing SLO Configuration (26 scenarios)

The following scenarios exist in candidate data but have no SLO thresholds configured:

  • coreapiscenario-core_dispatch_listeners
  • coreapiscenario-core_dispatch_no_listeners
  • coreapiscenario-core_dispatch_with_results_listeners
  • coreapiscenario-core_dispatch_with_results_no_listeners
  • djangosimple-baseline
  • errortrackingdjangosimple-baseline
  • errortrackingflasksqli-baseline
  • flasksimple-baseline
  • flasksqli-baseline
  • sethttpmeta-obfuscation-disabled
  • startup-baseline
  • startup-baseline_django
  • startup-baseline_flask
  • startup-ddtrace_run
  • startup-ddtrace_run_appsec
  • startup-ddtrace_run_profiling
  • startup-ddtrace_run_runtime_metrics
  • startup-ddtrace_run_send_span
  • startup-ddtrace_run_telemetry_disabled
  • startup-ddtrace_run_telemetry_enabled
  • startup-import_ddtrace
  • startup-import_ddtrace_auto
  • startup-import_ddtrace_auto_django
  • startup-import_ddtrace_auto_flask
  • startup-import_ddtrace_django
  • startup-import_ddtrace_flask

@PROFeNoM PROFeNoM added the MLObs ML Observability (LLMObs) label Jan 5, 2026
@PROFeNoM PROFeNoM marked this pull request as ready for review January 5, 2026 09:47
@PROFeNoM PROFeNoM requested review from a team as code owners January 5, 2026 09:47
github-advanced-security[bot]
github-advanced-security AI found potential problems Jan 6, 2026
View reviewed changes
Comment thread tests/llmobs/test_llmobs_routing_integration.py Dismissed
Comment thread tests/llmobs/test_llmobs_routing_integration.py Dismissed
@PROFeNoM
Merge remote-tracking branch 'origin/main' into alex/MLOB-4999_multi-…
c0054e4 
…tenant-routing-context-support
@PROFeNoM
fix test issues
2c11fcf 
1. Dictionary key ordering mismatch - Test expectations had {'role': ..., 'content': ...} but actual LLMObs code produces {'content': ..., 'role': ...} due to how Message TypedDict instances are constructed
2. Missing None routing context - The multi-tenant routing changes added a second routing parameter to enqueue(), but some tests weren't updated to include None in their mock assertions
3. metadata/tool_definitions ordering - Test utility set tool_definitions before metadata, but actual code sets them in reverse order
@cit-pr-commenter
Copy link
Copy Markdown

cit-pr-commenter Bot commented Jan 6, 2026 •
edited
Loading

Codeowners resolved as

ddtrace/llmobs/_llmobs.py                                               @DataDog/ml-observability
ddtrace/llmobs/_writer.py                                               @DataDog/ml-observability

brettlangdon
brettlangdon approved these changes Jan 6, 2026
View reviewed changes
Copy link
Copy Markdown
Member

@brettlangdon brettlangdon left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

release note lgtm

@PROFeNoM PROFeNoM marked this pull request as draft January 8, 2026 14:29
@PROFeNoM
Copy link
Copy Markdown
Contributor Author

PROFeNoM commented Jan 8, 2026

let me re-read through it

@PROFeNoM PROFeNoM marked this pull request as ready for review January 9, 2026 09:08
@github-actions github-actions Bot added the stale label Feb 9, 2026
@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Feb 10, 2026

This pull request has been automatically closed after a period of inactivity.
After this much time, it will likely be easier to open a new pull request with the
same changes than to update this one from the base branch. Please comment or reopen
if you think this pull request was closed in error.

@github-actions github-actions Bot closed this Feb 10, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@brettlangdon brettlangdon brettlangdon approved these changes

@wconti27 wconti27 Awaiting requested review from wconti27 wconti27 is a code owner automatically assigned from DataDog/apm-python

@christophe-papazian christophe-papazian Awaiting requested review from christophe-papazian christophe-papazian is a code owner automatically assigned from DataDog/apm-python

Assignees

No one assigned

Labels

MLObs ML Observability (LLMObs) stale

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@PROFeNoM @brettlangdon @github-advanced-security