Skip to content

update yutori template to n1.5#159

Draft
dprevoznik wants to merge 1 commit intomainfrom
hypeship/yutori-n15-template
Draft

update yutori template to n1.5#159
dprevoznik wants to merge 1 commit intomainfrom
hypeship/yutori-n15-template

Conversation

@dprevoznik
Copy link
Copy Markdown
Contributor

Summary

Updates the Yutori CUA template (TS + Python) from n1-latest to n1.5-latest.

This is more than a model-name swap — n1.5 changes several action signatures, adds new actions, and introduces a tool-set selector. The template is computer-use only (no Playwright page exposed to the model), so we explicitly exclude the DOM/Playwright "expanded" tools.

Loop / API changes

  • bump model id from n1-latest to n1.5-latest
  • send extra_body.tool_set: "browser_tools_core-20260403" to select the coordinate-based tool set (the default, but pinned for stability)
  • send extra_body.disable_tools: ["extract_elements", "find", "set_element_value", "execute_js"] as defense-in-depth — these are the expanded tools that need a Playwright page

Action / handler changes

  • rename hovermouse_move
  • key_press: parameter key_combkey
  • type: drop press_enter_after / clear_before_typing (n1.5 emits separate key_press actions instead)
  • new actions: middle_click, mouse_down, mouse_up, hold_key, go_forward
  • click actions: optional modifier parameter wired into Kernel's hold_keys for shift/ctrl-clicks
  • wait: optional duration parameter honored
  • hold_key: optional duration parameter honored via pressKey's duration

Files

  • pkg/create/templates.go — display name + description
  • pkg/templates/{typescript,python}/yutori/{loop,index|main,tools/computer,README}.* — implementation, types, docs

Test plan

  • make build and make test pass (verified locally)
  • scaffold the template (kernel create --template yutori) and deploy a sample task end-to-end against n1.5-latest
  • kick the tires on the new actions: shift-click, middle-click, hold_key, go_forward
  • verify the model never emits extract_elements / find / set_element_value / execute_js (should be excluded by tool_set + disable_tools)

- bump model id from `n1-latest` to `n1.5-latest`
- send `extra_body.tool_set: browser_tools_core-20260403` to use the
  coordinate-based tool set
- send `extra_body.disable_tools` to explicitly exclude the DOM/Playwright
  tools (`extract_elements`, `find`, `set_element_value`, `execute_js`)
  since this template runs computer-use only
- rename `hover` to `mouse_move`
- rename `key_press` parameter `key_comb` to `key`
- drop `press_enter_after` and `clear_before_typing` from `type` (n1.5
  emits separate `key_press` actions instead)
- add new actions: `middle_click`, `mouse_down`, `mouse_up`, `hold_key`,
  `go_forward`
- support optional `modifier` parameter on click actions via Kernel's
  `hold_keys`

Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant