Skip to content

[agent-sdk-j2s] agent-server runtime LLM switching#1544

Draft
enyst wants to merge 10 commits intoOpenHands:agent-sdk-26-llm-switchfrom
enyst:llm-server-switch
Draft

[agent-sdk-j2s] agent-server runtime LLM switching#1544
enyst wants to merge 10 commits intoOpenHands:agent-sdk-26-llm-switchfrom
enyst:llm-server-switch

Conversation

@enyst
Copy link
Copy Markdown
Collaborator

@enyst enyst commented Dec 29, 2025 •
edited
Loading

Implements runtime LLM switching end-to-end for remote clients (VS Code extension) without agent immutability/diff enforcement.

Key changes:

  • Agent is componentized: restore-time + runtime swaps (LLM, tools, context) are allowed; no diff-based enforcement.
  • Conversation persistence remains durable (base_state + events); LLM selection persists across restart; runtime secrets override persisted secrets on restore.
  • Agent-server REST: POST /api/conversations/{id}/llm (profile_id or inline llm) and POST /api/conversations/{id}/llm/switch.
  • Tests: agent-server wsproto integration covers large event history + restore + runtime LLM switching.

Docs: docs/llm_switching.md
Example: examples/02_remote_agent_server/07_llm_switch_and_restore.py

Docs: check-examples uses matching OpenHands/docs branches; docs PR OpenHands/docs#219 is optional follow-up for landing docs on main.
Beads: agent-sdk-j2s

@enyst enyst mentioned this pull request Dec 29, 2025
Closed
@enyst enyst force-pushed the agent-sdk-26-llm-switch branch from e6574f6 to a7a9326 Compare December 29, 2025 22:41
@enyst enyst force-pushed the llm-server-switch branch from f5d6265 to d49bf26 Compare December 29, 2025 22:43
@enyst enyst force-pushed the agent-sdk-26-llm-switch branch from a7a9326 to 90d0456 Compare December 29, 2025 22:45
@enyst enyst force-pushed the llm-server-switch branch 2 times, most recently from 7b3f8f0 to ff31fd7 Compare December 29, 2025 23:11
@enyst enyst force-pushed the agent-sdk-26-llm-switch branch from bec3c43 to fe9f0c7 Compare December 29, 2025 23:40
@enyst enyst force-pushed the llm-server-switch branch from 9e0ef19 to 89ea3d7 Compare December 29, 2025 23:40
@enyst
Copy link
Copy Markdown
Collaborator Author

enyst commented Dec 29, 2025

Rebased onto updated agent-sdk-26-llm-switch (which now includes latest upstream/main via profile branch). Only remaining failing check is check-examples, pending OpenHands/docs#219.

@enyst enyst force-pushed the agent-sdk-26-llm-switch branch from fe9f0c7 to 31ddf42 Compare December 29, 2025 23:54
@enyst enyst force-pushed the llm-server-switch branch from 89ea3d7 to d3a8fcb Compare December 29, 2025 23:55
@enyst enyst force-pushed the agent-sdk-26-llm-switch branch from 31ddf42 to e475956 Compare December 29, 2025 23:56
@enyst enyst force-pushed the llm-server-switch branch from d3a8fcb to 30c0007 Compare December 29, 2025 23:56
@enyst enyst requested a review from xingyaoww December 30, 2025 00:06
@enyst enyst mentioned this pull request Dec 30, 2025
Draft
@enyst enyst force-pushed the llm-server-switch branch from 12e3643 to 31ea0dd Compare December 30, 2025 00:29
@enyst enyst force-pushed the agent-sdk-26-llm-switch branch from 6eb0d14 to dba84fb Compare December 30, 2025 00:31
@enyst enyst force-pushed the llm-server-switch branch from 31ea0dd to b6e47cc Compare December 30, 2025 00:31
@enyst enyst mentioned this pull request Jan 1, 2026
Open
@all-hands-bot
Copy link
Copy Markdown
Collaborator

all-hands-bot commented Jan 13, 2026

[Automatic Post]: It has been a while since there was any activity on this PR. @enyst, are you still working on it? If so, please go ahead, if not then please request review, close it, or request that someone else follow up.

@all-hands-bot
Copy link
Copy Markdown
Collaborator

all-hands-bot commented Jan 28, 2026

[Automatic Post]: It has been a while since there was any activity on this PR. @enyst, are you still working on it? If so, please go ahead, if not then please request review, close it, or request that someone else follow up.

1 similar comment
@all-hands-bot
Copy link
Copy Markdown
Collaborator

all-hands-bot commented Feb 11, 2026

[Automatic Post]: It has been a while since there was any activity on this PR. @enyst, are you still working on it? If so, please go ahead, if not then please request review, close it, or request that someone else follow up.

@enyst enyst added behavior-initiative This is related to the system prompt sections and LLM steering. and removed behavior-initiative This is related to the system prompt sections and LLM steering. labels Feb 14, 2026
@enyst enyst mentioned this pull request Feb 21, 2026
Draft
@all-hands-bot
Copy link
Copy Markdown
Collaborator

all-hands-bot commented Mar 17, 2026

[Automatic Post]: It has been a while since there was any activity on this PR. @enyst, are you still working on it? If so, please go ahead, if not then please request review, close it, or request that someone else follow up.

@OpenHands OpenHands deleted a comment from all-hands-bot Mar 17, 2026
@enyst enyst mentioned this pull request Mar 17, 2026
Draft
@all-hands-bot
Copy link
Copy Markdown
Collaborator

all-hands-bot commented Apr 1, 2026

[Automatic Post]: It has been a while since there was any activity on this PR. @enyst, are you still working on it? If so, please go ahead, if not then please request review, close it, or request that someone else follow up.

1 similar comment
@all-hands-bot
Copy link
Copy Markdown
Collaborator

all-hands-bot commented Apr 15, 2026

[Automatic Post]: It has been a while since there was any activity on this PR. @enyst, are you still working on it? If so, please go ahead, if not then please request review, close it, or request that someone else follow up.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@xingyaoww xingyaoww Awaiting requested review from xingyaoww

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@enyst @all-hands-bot