arrow
返回

PMHO: Point-Supervised Oriented Object Detection Based on Segmentation-Driven Proposal Generation

delete2024-01-01
delete0
PRE
AI
S
Shun Zhang
J
Jihui Long
徐要辉 封面图
徐要辉 (Yaohui Xu)
S
Shaohui Mei *
DOI:10.1109/TGRS.2024.3450732delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Oriented object detection has gained increasing attention due to its ability to detect objects with arbitrary orientations in the field of remote sensing (RS) images. However, the laborious task of annotating oriented bounding boxes (OBBs) presents significant challenges for training a fully supervised arbitrary-oriented object detector. Some existing approaches apply annotated horizontal bounding boxes (HBBs) as weakly supervised signals, in which even HBB annotations require significant human efforts. In this article, we propose a point-to-mask-to-HBB-to-OBB (PMHO) method that achieves weakly supervised oriented object detection by requiring only single-point object annotations. Specifically, we first take the input images and the given annotated points as prompts to obtain the initial segmentation masks, and then present a neighboring mask combination scheme to address the over-segmentation issue and a point-centric mask selection strategy to filtrate the related masks. Based on positive and negative proposal bags transferred from the mask regions, the pseudo-HBB generation network which consists of a classification branch for classification and an instance branch for the localization of individual proposals, aims to generate pseudo HBBs for each object. For further refinement of pseudo HBBs, we present a pseudo-HBB filtering strategy with K-means clustering on features extracted by a CNN model pretrained on a large-scale offline RS dataset. To train the oriented object detector, an inscribed ellipse constraint is proposed to measure the regression loss between predicted OBBs and the given pseudo HBBs. Extensive experiments including OBB detection, pseudo-HBB generation, and ablation studies are conducted on public DIOR and DIOR-R datasets, which demonstrates that our method achieves state-of-the-art performance.
Keyword:
Object detection
Proposals
Annotations
Remote sensing
Task analysis
Loss measurement
Accuracy
Inscribed ellipse constraint
oriented object detection
point-centric proposal generation
point-supervised object detection

期刊

IEEE Transactions on Geoscience and Remote Sensing 封面图
IEEE Transactions on Geoscience and Remote Sensing
IF:
8.6
论文数:
2.2W
被引数:
10.7W

机构

N
Northwestern Polytechnical University
学者数:
4.6W
论文数: 3.7W
被引数: 5.3W
引用论文

引用论文

A Deep Multitask Convolutional Neural Network for Remote Sensing Image Super-Resolution and Colorization
err2022-01-01
err14
errOAAI
errFeng, Jianan; Jiang, Qian; Tseng, Ching-Hsun; Jin, Xin; Liu, Ling; Zhou, Wei; Yao, Shaowen
err分享
err收藏
Learning Remote Sensing Object Detection With Single Point Supervision
err2024-01-01
err5
errOAAI
errHe, Shitian; Zou, Huanxin; Wang, Yingqian; Li, Boyang; Cao, Xu; Jing, Ning
err分享
err收藏
Inhibition of autophagy augments chemotherapy in human salivary adenoid cystic carcinoma
err2013-10-09
err0
PREAI
errLicheng Jiang; Shengyun Huang; Dongsheng Zhang; Bin Zhang; Keyi Li; Wengang Li; Shizhou Zhang; Weidong Zhang; Peihui Zheng
err分享
err收藏
学者 查看更多内容