arrow
返回

Active 6D pose estimation for textureless objects using multi-view RGB frames

delete2026-01-27
delete0
PRE
AI
J
Jun Yang
W
Wenjie Xue
S
Sahar Ghavidel
S
Steven L. Waslander
DOI:10.1177/02783649251411922delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Estimating the 6D pose of textureless objects from RGB images is an important problem in robotics. Due to appearance ambiguities, rotational symmetries, and severe occlusions, single-view based 6D pose estimators are still unable to handle a wide range of objects, motivating research towards multi-view pose estimation and next-best-view prediction that addresses these limitations. In this work, we propose a comprehensive active perception framework for estimating the 6D poses of textureless objects using only RGB images. Our approach is built upon a key idea: decoupling the 6D pose estimation into a two-step sequential process can greatly improve both accuracy and efficiency. First, we estimate the 3D translation of each object, resolving scale and depth ambiguities inherent to RGB images. These estimates are then used to simplify the subsequent task of determining the 3D orientation, which we achieve through canonical scale template matching. Building on this formulation, we then introduce an active perception strategy that predicts the next best camera viewpoint to capture an RGB image, effectively reducing object pose uncertainty and enhancing pose accuracy. We evaluate our method on the public ROBI and TOD datasets, as well as on our reconstructed transparent object dataset, T-ROBI. Under the same camera viewpoints, our multi-view pose estimation significantly outperforms state-of-the-art approaches. Furthermore, by leveraging our next-best-view strategy, our approach achieves high pose accuracy with fewer viewpoints than heuristic-based policies across all evaluated datasets. The accompanying video and T-ROBI dataset will be released on our project page: https://trailab.github.io/ActiveODPE .

期刊

T
The International Journal of Robotics Research
IF:
0
论文数:
126
被引数:
0

机构

E
epson canada ltd.
学者数:
2
论文数: 1
被引数: 0
U
University of Toronto Institute for Aerospace Studies
学者数:
7
论文数: 4
被引数: 0
引用论文

引用论文

err分享
err收藏
err分享
err收藏
Multi-View Object Pose Refinement With Differentiable Renderer
err2021-04-01
err0
errOAAI
errIvan Shugurov; Ivan Pavlov; Sergey Zakharov; Slobodan Ilic
err分享
err收藏
6-DoF object pose from semantic keypoints
err2017-05-01
err0
errOAAI
errGeorgios Pavlakos; Xiaowei Zhou; Aaron Chan; Konstantinos G. Derpanis; Kostas Daniilidis
err分享
err收藏
ZebraPose: Coarse to Fine Surface Encoding for 6DoF Object Pose Estimation
err2022-06-01
err0
errOAAI
errYongzhi Su; Mahdi Saleh; Torben Fetzer; Jason Rambach; Nassir Navab; Benjamin Busam; Didier Stricker; Federico Tombari
err分享
err收藏
学者 查看更多内容