arrow
Return

Active 6D pose estimation for textureless objects using multi-view RGB frames

delete2026-01-27
delete0
PRE
AI
J
Jun Yang
W
Wenjie Xue
S
Sahar Ghavidel
S
Steven L. Waslander
DOI:10.1177/02783649251411922delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Estimating the 6D pose of textureless objects from RGB images is an important problem in robotics. Due to appearance ambiguities, rotational symmetries, and severe occlusions, single-view based 6D pose estimators are still unable to handle a wide range of objects, motivating research towards multi-view pose estimation and next-best-view prediction that addresses these limitations. In this work, we propose a comprehensive active perception framework for estimating the 6D poses of textureless objects using only RGB images. Our approach is built upon a key idea: decoupling the 6D pose estimation into a two-step sequential process can greatly improve both accuracy and efficiency. First, we estimate the 3D translation of each object, resolving scale and depth ambiguities inherent to RGB images. These estimates are then used to simplify the subsequent task of determining the 3D orientation, which we achieve through canonical scale template matching. Building on this formulation, we then introduce an active perception strategy that predicts the next best camera viewpoint to capture an RGB image, effectively reducing object pose uncertainty and enhancing pose accuracy. We evaluate our method on the public ROBI and TOD datasets, as well as on our reconstructed transparent object dataset, T-ROBI. Under the same camera viewpoints, our multi-view pose estimation significantly outperforms state-of-the-art approaches. Furthermore, by leveraging our next-best-view strategy, our approach achieves high pose accuracy with fewer viewpoints than heuristic-based policies across all evaluated datasets. The accompanying video and T-ROBI dataset will be released on our project page: https://trailab.github.io/ActiveODPE .

Journal

T
The International Journal of Robotics Research
IF:
0
Papers:
126
Citations:
0

Organization

E
epson canada ltd.
Scholars:
2
Papers: 1
Citations: 0
Cited Papers

Cited Papers

errShare
errSave
Multi-View Object Pose Refinement With Differentiable Renderer
err2021-04-01
err0
errOAAI
errIvan Shugurov; Ivan Pavlov; Sergey Zakharov; Slobodan Ilic
errShare
errSave
Self-supervised 6D Object Pose Estimation for Robot Manipulation
err2020-05-01
err0
errOAAI
errXinke Deng; Yu Xiang; Arsalan Mousavian; Clemens Eppner; Timothy Bretl; Dieter Fox
errShare
errSave
6-DoF object pose from semantic keypoints
err2017-05-01
err0
errOAAI
errGeorgios Pavlakos; Xiaowei Zhou; Aaron Chan; Konstantinos G. Derpanis; Kostas Daniilidis
errShare
errSave
ZebraPose: Coarse to Fine Surface Encoding for 6DoF Object Pose Estimation
err2022-06-01
err0
errOAAI
errYongzhi Su; Mahdi Saleh; Torben Fetzer; Jason Rambach; Nassir Navab; Benjamin Busam; Didier Stricker; Federico Tombari
errShare
errSave
researcher View more