.png){kind=icon}
返回
Certifiable Object Pose Estimation: Foundations, Learning Models, and Self-Training
.png){kind=icon}
PRE
AI
DOI：10.1109/TRO.2023.3271568.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
In this article, we consider a certifiable object pose estimation problem, where-given a partial point cloud of an object-the goal is to not only estimate the object pose, but also provide a certificate of correctness for the resulting estimate. Our first contribution is a general theory of certification for end-to-end perception models. In particular, we introduce the notion of ?-correctness, which bounds the distance between an estimate and the ground truth. We then show that ?-correctness can be assessed by implementing two certificates: 1) a certificate of observable correctness, which asserts if the model output is consistent with the input data and prior information; and 2) a certificate of nondegeneracy, which asserts whether the input data are sufficient to compute a unique estimate. Our second contribution is to apply this theory and design a new learning-based certifiable pose estimator. In particular, we propose C-3PO, a semantic-keypoint-based pose estimation model, augmented with the two certificates, to solve the certifiable pose estimation problem. C-3PO also includes a keypoint corrector, implemented as a differentiable optimization layer, that can correct large detection errors (e.g., due to the sim-to-real gap). Our third contribution is a novel self-supervised training approach that uses our certificate of observable correctness to provide the supervisory signal to C-3PO during training. In it, the model trains only on the observably correct input-output pairs produced in each batch and at each iteration. As training progresses, we see that the observably correct input-output pairs grow, eventually reaching near 100% in many cases. We conduct extensive experiments to evaluate the performance of the corrector, the certification, and the proposed self-supervised training using the ShapeNet and YCB datasets. The experiments show that 1) standard semantic-keypoint-based methods (which constitute the backbone of C-3PO) outperform more recent alternatives in challenging problem instances; 2) C-3PO further improves performance and significantly outperforms all the baselines; and 3) C-3PO's certificates are able to discern correct pose estimates.(1)
Keyword:
Certifiable models
computer vision
3D robot vision
object pose estimation
safe perception
self-supervised learning
期刊
IF:
10.5
论文数:
3.3K
被引数:
2.8W
机构
暂无机构信息
引用论文
Subversion of Autophagy in Adherent Invasive Escherichia coli-Infected Neutrophils Induces Inflammation and Cell Death.png)
PLoS ONE
OAAI
PLoS ONEIF0
OAAI分享收藏Data-processing artefacts in three-dimensional dive path reconstruction from geomagnetic and acceleration data从地磁和加速度数据进行三维潜水路径重建中的数据处理伪像
PREAI
分享收藏
查看更多内容