Skip to content

[MLOB-6991] Add session interaction type to LLM Observability API spec #3290

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
api-clients-generation-pipeline wants to merge 1 commit into
base: master
Choose a base branch
from
Open

[MLOB-6991] Add session interaction type to LLM Observability API spec #3290

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
12 changes: 7 additions & 5 deletions .generator/schemas/v2/openapi.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -38173,7 +38173,7 @@ components:
$ref: "#/components/schemas/LLMObsAnnotationItem"
type: array
content_id:
description: Identifier of the content for this interaction.
description: Identifier of the content (trace ID or session ID) for this interaction.
example: "trace-abc-123"
type: string
id:
Expand Down Expand Up @@ -38376,7 +38376,7 @@ components:
description: A single interaction to add to an annotation queue.
properties:
content_id:
description: Identifier of the content (such as trace ID) for this interaction.
description: Identifier of the content (trace ID or session ID) for this interaction.
example: "trace-abc-123"
type: string
type:
Expand All @@ -38393,7 +38393,7 @@ components:
example: false
type: boolean
content_id:
description: Identifier of the content for this interaction.
description: Identifier of the content (trace ID or session ID) for this interaction.
example: "trace-abc-123"
type: string
id:
Expand Down Expand Up @@ -39912,11 +39912,13 @@ components:
enum:
- trace
- experiment_trace
- session
example: trace
type: string
x-enum-varnames:
- TRACE
- EXPERIMENT_TRACE
- SESSION
LLMObsLabelSchema:
description: Schema definition for a single label in an annotation queue.
properties:
Expand Down Expand Up @@ -104738,7 +104740,7 @@ paths:
If you have any feedback, contact [Datadog support](https://docs.datadoghq.com/help/).
/api/v2/llm-obs/v1/annotation-queues/{queue_id}/annotated-interactions:
get:
description: Retrieve all interactions and their annotations for a given annotation queue.
description: Retrieve all interactions (traces and sessions) and their annotations for a given annotation queue.
operationId: GetLLMObsAnnotatedInteractions
parameters:
- $ref: "#/components/parameters/LLMObsAnnotationQueueIDPathParameter"
Expand Down Expand Up @@ -104787,7 +104789,7 @@ paths:
/api/v2/llm-obs/v1/annotation-queues/{queue_id}/interactions:
post:
description: |-
Add one or more interactions (traces) to an annotation queue.
Add one or more interactions (traces or sessions) to an annotation queue.
At least one interaction must be provided.
operationId: CreateLLMObsAnnotationQueueInteractions
parameters:
Expand Down
4 changes: 2 additions & 2 deletions lib/datadog_api_client/v2/api/llm_observability_api.rb
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -109,7 +109,7 @@ def create_llm_obs_annotation_queue_interactions(queue_id, body, opts = {})

# Add annotation queue interactions.
#
# Add one or more interactions (traces) to an annotation queue.
# Add one or more interactions (traces or sessions) to an annotation queue.
# At least one interaction must be provided.
#
# @param queue_id [String] The ID of the LLM Observability annotation queue.
Expand Down Expand Up @@ -1100,7 +1100,7 @@ def get_llm_obs_annotated_interactions(queue_id, opts = {})

# Get annotated queue interactions.
#
# Retrieve all interactions and their annotations for a given annotation queue.
# Retrieve all interactions (traces and sessions) and their annotations for a given annotation queue.
#
# @param queue_id [String] The ID of the LLM Observability annotation queue.
# @param opts [Hash] the optional parameters
Expand Down
2 changes: 1 addition & 1 deletion lib/datadog_api_client/v2/models/llm_obs_annotated_interaction_item.rb
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -24,7 +24,7 @@ class LLMObsAnnotatedInteractionItem
# List of annotations for this interaction.
attr_reader :annotations

# Identifier of the content for this interaction.
# Identifier of the content (trace ID or session ID) for this interaction.
attr_reader :content_id

# Unique identifier of the interaction.
Expand Down
2 changes: 1 addition & 1 deletion lib/datadog_api_client/v2/models/llm_obs_annotation_queue_interaction_item.rb
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -21,7 +21,7 @@ module DatadogAPIClient::V2
class LLMObsAnnotationQueueInteractionItem
include BaseGenericModel

# Identifier of the content (such as trace ID) for this interaction.
# Identifier of the content (trace ID or session ID) for this interaction.
attr_reader :content_id

# Type of interaction in an annotation queue.
Expand Down
2 changes: 1 addition & 1 deletion lib/datadog_api_client/v2/models/llm_obs_annotation_queue_interaction_response_item.rb
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -24,7 +24,7 @@ class LLMObsAnnotationQueueInteractionResponseItem
# Whether this interaction already existed in the queue.
attr_reader :already_existed

# Identifier of the content for this interaction.
# Identifier of the content (trace ID or session ID) for this interaction.
attr_reader :content_id

# Unique identifier of the interaction.
Expand Down
1 change: 1 addition & 0 deletions lib/datadog_api_client/v2/models/llm_obs_interaction_type.rb
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -23,5 +23,6 @@ class LLMObsInteractionType

TRACE = "trace".freeze
EXPERIMENT_TRACE = "experiment_trace".freeze
SESSION = "session".freeze
end
end
Loading