Skip to content

Dedup sam2 and sam3 models#563

Open
dsobek wants to merge 1 commit intomainfrom
deduplicate-sam-models
Open

Dedup sam2 and sam3 models#563
dsobek wants to merge 1 commit intomainfrom
deduplicate-sam-models

Conversation

@dsobek
Copy link
Copy Markdown

@dsobek dsobek commented Apr 3, 2026

src/ went from 5.9G to 4.2G.

To validate this PR, you can run all the changed objectives (I've already done this).

Closes https://github.com/PickNikRobotics/moveit_pro/issues/17828

@dsobek dsobek added this to the 9.1.1 milestone Apr 3, 2026
@dsobek dsobek self-assigned this Apr 3, 2026
@dsobek dsobek requested a review from rlpratt12 April 3, 2026 22:22
Copy link
Copy Markdown
Member

@nbbrooks nbbrooks left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Retarget to ...main?

Also should we be concerned about some of the re-rdering and utf v UTF? Is your linter settings out of sync with what is aimed at main or did we change something in that recently?

@dsobek
Copy link
Copy Markdown
Author

dsobek commented Apr 3, 2026

Retarget to ...main?

Also should we be concerned about some of the re-rdering and utf v UTF? Is your linter settings out of sync with what is aimed at main or did we change something in that recently?

I figured this can catch 9.1.1 and this'll get merged back to main after release.

For the linter settings, which diff are you referring to?

@dsobek dsobek requested a review from nbbrooks April 3, 2026 22:33
@dsobek
Copy link
Copy Markdown
Author

dsobek commented Apr 6, 2026

Actually you are right Nathan, this should probably go through QA. I'll retarget to 9.2/main.

@dsobek dsobek marked this pull request as draft April 6, 2026 15:30
@dsobek dsobek modified the milestones: 9.1.1, 9.2.0 Apr 6, 2026
@dsobek dsobek force-pushed the deduplicate-sam-models branch from 58383f9 to 4935837 Compare April 6, 2026 16:09
@dsobek dsobek changed the base branch from v9.1 to main April 6, 2026 16:09
@dsobek dsobek marked this pull request as ready for review April 6, 2026 16:10
@dsobek dsobek closed this Apr 6, 2026
@dsobek dsobek reopened this Apr 6, 2026
Copy link
Copy Markdown
Member

@nbbrooks nbbrooks left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

$ find . -name *onnx
./src/factory_sim/models/sam2.1_decoder.onnx
./src/factory_sim/models/sam2.1_hiera_l_image_encoder.onnx
./src/factory_sim/models/sam2.1_prompt_encoder.onnx
./src/lab_sim/models/l2g.onnx
./src/moveit_pro_sam2/models/sam2_decoder.onnx
./src/moveit_pro_sam2/models/sam2_hiera_large_encoder.onnx
./src/moveit_pro_clipseg/models/clipseg.onnx
./src/moveit_pro_clipseg/models/clip.onnx
./src/kitchen_sim/models/l2g.onnx
./src/external_dependencies/phoebe_ws/src/phoebe_sim/models/l2g.onnx
./src/moveit_pro_sam3/models/sam3_text_encoder.onnx
./src/moveit_pro_sam3/models/sam3_decoder.onnx
./src/moveit_pro_sam3/models/sam3_geometry_encoder.onnx
./src/moveit_pro_sam3/models/sam3_vision_encoder.onnx

Looks like there is some hidden stuff in factory_sim still.

The l2g files are 15M so I dont see an urgent need to put that into its own repo in this PR

@dsobek
Copy link
Copy Markdown
Author

dsobek commented Apr 7, 2026

$ find . -name *onnx
./src/factory_sim/models/sam2.1_decoder.onnx
./src/factory_sim/models/sam2.1_hiera_l_image_encoder.onnx
./src/factory_sim/models/sam2.1_prompt_encoder.onnx
./src/lab_sim/models/l2g.onnx
./src/moveit_pro_sam2/models/sam2_decoder.onnx
./src/moveit_pro_sam2/models/sam2_hiera_large_encoder.onnx
./src/moveit_pro_clipseg/models/clipseg.onnx
./src/moveit_pro_clipseg/models/clip.onnx
./src/kitchen_sim/models/l2g.onnx
./src/external_dependencies/phoebe_ws/src/phoebe_sim/models/l2g.onnx
./src/moveit_pro_sam3/models/sam3_text_encoder.onnx
./src/moveit_pro_sam3/models/sam3_decoder.onnx
./src/moveit_pro_sam3/models/sam3_geometry_encoder.onnx
./src/moveit_pro_sam3/models/sam3_vision_encoder.onnx

Looks like there is some hidden stuff in factory_sim still.

The l2g files are 15M so I dont see an urgent need to put that into its own repo in this PR

Yeah I noticed, I asked griz about this and that is SAM 2.1. I figured to keep things a bit focused I would ignore that for now. It is only used once anyhow.

@griswaldbrooks Going forward we are really only using SAM3 right? Should I do anything special with SAM 2.1?

@griswaldbrooks
Copy link
Copy Markdown

@griswaldbrooks Going forward we are really only using SAM3 right? Should I do anything special with SAM 2.1?

I never said we were only going to use SAM3 moving forward. SAM3 doesn't support points at the moment (in our implementation) so SAM2 and SAM2.1 will live on for the forseeable future. Even when we do port in the point based input for SAM3 if we did want to depreciate SAM2/2.1 we would have to refactor those behaviors, which will take time.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants