diff --git a/PW45_2026_Boston/Projects/TrainingRobotMotionsUsingSlicerImages/README.md b/PW45_2026_Boston/Projects/TrainingRobotMotionsUsingSlicerImages/README.md new file mode 100644 index 000000000..357676214 --- /dev/null +++ b/PW45_2026_Boston/Projects/TrainingRobotMotionsUsingSlicerImages/README.md @@ -0,0 +1,89 @@ +--- +layout: pw45-project + +permalink: /:path/ + +project_title: Training Robot Motions Using Slicer Images +category: IGT and Training +presenter_location: + +key_investigators: + +- name: Taewoo Yoon + affiliation: AIRS Inc + country: Republic of Korea + +- name: Joonho Seo + affiliation: Korea Institute of Machinery Materials + country: Republic of Korea + +--- + +# Project Description + + + + +3D Slicer can function as a tool to display real-time object movements in a 3D view. +We intend to utilize this **3D view as training data for robotic motion**. +The 3D Slicer view will function just like a real camera mounted on the robot. +Furthermore, it will allow us to build **custom simulation environments to generate and train on virtual data**. + +Image + + + +## Objective + + + + +- Establishing a pipeline to integrate 3D Slicer's visual data with robot joint data for advanced policy learning and real-time inference. +- Establishing an environment dedicated to generating and training on synthetic simulation data. + +Image + + + +## Approach and Plan + + + + +1. Establishing an environment to track an object rigidly coupled with the robot in the 3D view, ensuring its pose updates dynamically in accordance with the robot's motion. +2. Capture the 3D view for a specified number of frames while simultaneously acquiring the corresponding robot joint data. +3. Train the policy based on the training dataset created in step 2. +4. After training the policy, inferred joint positions are fed as control commands into either a simulation tool or physical robot. +5. Input the 3D Slicer view into the trained model for inference. +6. Feed the inferred joint position into either the simulation tool or physical robot, and sequentially input the updated 3D Slicer view as the next state input as the robot moves. + + + +## Progress and Next Steps + + + + +1. Describe specific steps you **have actually done**. + + + + +# Illustrations + + + + +_No response_ + + + +# Background and References + + + + +_No response_ +