Skip to content

test: add cross-process or multi-worker runtime validation for example integrations #38

Description

@rlippmann

Proposed enforcement point

runtime concurrency and process-boundary validation

Domain

cross-process and multi-worker integration behavior

Runtime or framework

LiteLLM Proxy / Open WebUI / other runtime-backed integrations as applicable

Why existing examples do not cover it

Current tests primarily validate in-process behavior and single-worker runtime smoke paths. The repository does not yet cover the cases where runtime behavior changes across process boundaries or under multi-worker execution.

This gap may include:

  • LiteLLM Proxy behavior with more than one worker
  • checkpoint/state behavior across process boundaries where relevant
  • explicit validation of examples that intentionally do not provide cross-process guarantees
  • documentation and test coverage for which integrations are single-process teaching examples versus runtime surfaces that should tolerate worker/process boundaries

This should be tracked separately from both the Open WebUI loading/registration gap and any future streaming-specific validation work.

Where does this belong?

context-compiler-example-integrations

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions