arrow
返回

InstaBoost plus plus : Visual Coherence Principles for Unified 2D/3D Instance Level Data Augmentation

delete2023-06-17
delete1
PRE
AI
J
Jianhua Sun
H
Hao-Shu Fang
Y
Yuxuan Li
R
Runzhong Wang
M
Minghao Gou
C
Cewu Lu *
DOI:10.1007/s11263-023-01807-9delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Instance-level perception tasks like object detection, instance segmentation, and 3D detection require many training samples to achieve satisfactory performance. The meticulous labels for these tasks are usually expensive to obtain and data augmentation is a natural choice to tackle such a problem. However, instance-level augmentation is less studied in previous research. In this paper, we present an effective, efficient and unified crop-paste mechanism to augment the training set utilizing existing instance-level annotations. Our design is derived from visual coherence and mines three inherent principles that widely exist in real-world data: (i) background coherence in local neighbor area, (ii) appearance coherence for instance placement, and (iii) instance coherence within the same category. Such methodologies are unified for various tasks including object detection, instance segmentation, and 3D detection. Extensive experiments demonstrate that our proposed approaches can successfully boost the performance of diverse frameworks on various datasets across multiple tasks, without modifying the network structure. Remarkable improvements are obtained: 5.1 mAP for object detection and 3.2 mAP for instance segmentation on COCO dataset, and 6.9 mAP for 3D detection on ScanNetV2 dataset. Our method can be easily integrated into different frameworks without affecting the training and inference efficiency.
Keyword:
Data augmentation
Visual coherence
Object detection
Instance segmentation
3D detection

期刊

International Journal of Computer Vision 封面图
International Journal of Computer Vision
IF:
9.3
论文数:
3.9K
被引数:
2.8W

机构

S
shanghai jiao tong university
学者数:
15.7W
论文数: 11.7W
被引数: 159
引用论文

引用论文

Conductivity Enhancement in Thin Silicon-on-Insulator Layer Embedding Artificial Dislocation Network
err2011-02-01
err0
PREAI
errYasuhiko Ishikawa; Kazuaki Yamauchi; Chihiro Yamamoto; Michiharu Tabe
err分享
err收藏
Existence of Nash equilibrium for chance-constrained games
err2016-09-01
err0
PREAI
errVikas Vikram Singh; Oualid Jouini; Abdel Lisser
err分享
err收藏
The myeloma cell antigen syndecan‐1 is lost by apoptotic myeloma cells
err2001-12-25
err0
errOAAI
errMichel Jourdan; Martine Ferlin; Eric Legouffe; Mira Horvathova; Janny Liautard; Jean FranÇois Rossi; John Wijdenes; Jean Brochier; Bernard Klein
err分享
err收藏
The oxygen effect and fractionated radiotherapy
err2012-12-20
err0
PREAI
errMichael Horsman; Bradly Wouters; Michael Joiner; Jens Overgaard
err分享
err收藏
Diagnosis of Coeliac Disease in Children Younger Than 2 Years
err2013-02-01
err0
errOAAI
errZrinjka Mišak; Iva Hojsak; Oleg Jadrešin; Alemka Jaklin Kekez; Slaven Abdović; Sanja Kolaček
err分享
err收藏
err分享
err收藏
学者 查看更多内容