Convert 2D Calculation Results to 3D Pose


After completing 2D segmentation, could you please explain how to combine the segmentation results into 3D pick points?

For example:

Process the 2D image to obtain segmentation zones.
Segmentation Zone Processing: Calculate the segmentation center point, set the long axis as the orientation.
Obtain 3D pose’s XYZ: Correspond the 2D center pixel point to the point cloud to obtain the XYZ position.
Obtain 3D pose’s RPY: [How to convert 1D 2D orientation to 3D pose RPY?]
Combine and transform 3D poses.
Thank you.

Thank you for the information. To combine into 3D pick points, we can use the following methods:

These methods will help in synthesizing the 3D pick points effectively.