arrow
返回

Pre-trained SAM as data augmentation for image segmentation

delete2024-10-08
delete0
delete
OA
AI
J
Junjun Wu
Y
Yunbo Rao *
S
Shaoning Zeng *
B
Bob Zhang
DOI:10.1049/cit2.12381delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Data augmentation plays an important role in training deep neural model by expanding the size and diversity of the dataset. Initially, data augmentation mainly involved some simple transformations of images. Later, in order to increase the diversity and complexity of data, more advanced methods appeared and evolved to sophisticated generative models. However, these methods required a mass of computation of training or searching. In this paper, a novel training-free method that utilises the Pre-Trained Segment Anything Model (SAM) model as a data augmentation tool (PTSAM-DA) is proposed to generate the augmented annotations for images. Without the need for training, it obtains prompt boxes from the original annotations and then feeds the boxes to the pre-trained SAM to generate diverse and improved annotations. In this way, annotations are augmented more ingenious than simple manipulations without incurring huge computation for training a data augmentation model. Multiple comparative experiments on three datasets are conducted, including an in-house dataset, ADE20K and COCO2017. On this in-house dataset, namely Agricultural Plot Segmentation Dataset, maximum improvements of 3.77% and 8.92% are gained in two mainstream metrics, mIoU and mAcc, respectively. Consequently, large vision models like SAM are proven to be promising not only in image segmentation but also in data augmentation.
Keyword:
data augmentation
image segmentation
large model
segment anything model

期刊

CAAI Transactions on Intelligence Technology 封面图
CAAI Transactions on Intelligence Technology
IF:
7.3
论文数:
664
被引数:
2.4K

机构

U
University of Macau
学者数:
1.1W
论文数: 1.3W
被引数: 2.0W
引用论文

引用论文

Clinical features and surgical outcome in 25 patients with fenestrations of the coronary sinus
err2007-10-24
err0
PREAI
errChristine H. Attenhofer Jost; Heidi M. Connolly; Gordon K. Danielson; Joseph A. Dearani; Carole A. Warnes; A. Jamil Tajik
err分享
err收藏
Using Super Learner Prediction Modeling to Improve High-dimensional Propensity Score Estimation
err2018-01-01
err0
PREAI
errRichard Wyss; Sebastian Schneeweiss; Mark van der Laan; Samuel D. Lendle; Cheng Ju; Jessica M. Franklin
err分享
err收藏
Stability of adaptive behaviors in middle-school children with autism spectrum disorders
err2007-10-01
err0
PREAI
errRobin L. Gabriels; Bonnie Jean Ivers; Dina E. Hill; John A. Agnew; John McNeill
err分享
err收藏
A Comprehensive Survey of Image Augmentation Techniques for Deep Learning
err2023-05-01
err176
errOAAI
errXu, Mingle; Yoon, Sook; Fuentes, Alvaro; Park, Dong Sun
err分享
err收藏
ACP Risk Grade: A Simple Mortality Index for Patients with Confirmed or Suspected Severe Acute Respiratory Syndrome Coronavirus 2 Disease (COVID-19) During the Early Stage of Outbreak in Wuhan, China
err2020-01-01
err0
errOAAI
errJiatao Lu; Shufang Hu; Rong Fan; Zhihong Liu; Xueru Yin; Qiongya Wang; Qingquan Lv; Zhifang Cai; Haijun Li; Yuhai Hu; Ying Han; Hongping Hu; Wenyong Gao; Shibo Feng; Qiongfang Liu; Hui Li; Jian Sun; Jie Peng; Xuefeng Yi; Zixiao Zhou; Yabing Guo; Jinlin Hou
err分享
err收藏
学者 查看更多内容