arrow
Return

Pseudo-Siamese Teacher for Semi-Supervised Oriented Object Detection

delete2024-01-01
delete5
PRE
AI
W
Wenhao Wu
H
Hau−San Wong *
吴思 (Si Wu)
DOI:10.1109/TGRS.2024.3380645delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Oriented object detection, which aims at detecting objects with orientation properties, shows great potential for visual analysis in complex scenarios, such as aerial images. However, the powerful detection performance relies on abundant and accurate annotations and deteriorates once the annotations become insufficient. Semi-supervised learning, which utilizes unannotated data to improve the target model, is a promising method to address the problem of annotation deficiency. In this work, we propose Pseudo-Siamese teacher (PST), a new semi-supervised learning framework for oriented object detection. In this architecture, two teacher models, updated from the same student model with different optimizations, inspect the predictions of each other and collaborate to generate high-quality pseudo annotations. To reduce the unreliability of pseudo annotations on the localization, scale, and orientation, we propose to model the oriented object as a Gaussian distribution and apply a symmetric and bounded Jensen-Shannon divergence (JSD) to evaluate the divergence between predictions of different teacher models, the results of which serve as an indicator to remove confusing pseudo annotations without consistent regression estimation of teacher models. Scale invariance is also an important challenge in oriented object detection, which we address by proposing a scale-adaptive knowledge distillation to align information between the feature maps from the student model on images with flexible scales and the feature maps, interpolated from adjacent feature maps with scales closest to that of the down-sampled images, from the teacher models. We perform extensive experiments to demonstrate the effectiveness of our proposed method in leveraging unannotated data for performance improvement.
Keywords:
Annotations
Object detection
Feature extraction
Data models
Training
Predictive models
Adaptation models
Oriented object detection
semi-supervised learning

Journal

IEEE Transactions on Geoscience and Remote Sensing cover
IEEE Transactions on Geoscience and Remote Sensing
IF:
8.6
Papers:
2.1W
Citations:
10.7W

Organization

C
City University of Hong Kong
Scholars:
2.3W
Papers: 3.0W
Citations: 6.1W
S
south china university of technology
Scholars:
6.7W
Papers: 5.1W
Citations: 85