arrow
Return

Module-Pruning-Based Neural Architectural Search for Remote Sensing Image Captioning

delete2025-01-01
delete0
PRE
AI
Y
Yogendra Rao Musunuri
C
Changwon Kim
O
Oh‐Seol Kwon
Sun-Yuan Kung cover
Sun-Yuan Kung (Sun‐Yuan Kung)
DOI:10.1109/LGRS.2025.3593475delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Remote sensing image captioning (RSIC) has garnered significant attention for enhancing the interpretability of aerial imagery through textual descriptions. Conventional approaches employ convolutional neural networks (CNNs) for visual feature extraction paired with recurrent neural networks (RNNs) or transformers for caption generation. However, these architectures suffer from high complexity and computational costs. While neural architecture search (NAS) via network pruning has been extensively studied, module-based pruning for RSIC systems remains largely unexplored. We propose a novel dedicated decoder pruning methodology for sequential caption generators—a module-based pruning method for end-to-end encoder–decoder architectural adaptation. It features two key innovations: 1) structured pruning of a pre-trained ResNet encoder and transformer encoder–decoder components and 2) a cross-entropy-based caption matching strategy replacing conventional prediction training in the decoder’s final layer. The proposed method enables simultaneously enhancing inference efficiency and reducing storage requirements without compromising performance. As evaluated on the RSICD dataset using CIDEr, ROUGE, METEOR, bilingual evaluation understudy (BLEU), and Sm metrics, our method achieves 42.8% model size reduction while improving accuracy, establishing new benchmarks in efficient RSIC.
Keywords:
Model complexity
module-pruning
multimodal
neural architecture search (NAS)
remote sensing image captioning (RSIC)
transformer

Journal

IEEE Geoscience and Remote Sensing Magazine cover
IEEE Geoscience and Remote Sensing Magazine
IF:
16.4
Papers:
1.0W
Citations:
5.1K

Organization

P
Princeton University
Scholars:
2.1W
Papers: 2.3W
Citations: 5.1W
C
Changwon National University
Scholars:
2.0K
Papers: 1.9K
Citations: 2
Cited Papers

Cited Papers

Interacting-Enhancing Feature Transformer for Cross-Modal Remote-Sensing Image and Text Retrieval
err2023-01-01
err32
PREAI
errTang, Xu; Wang, Yijing; Ma, Jingjing; Zhang, Xiangrong; Liu, Fang; Jiao, Licheng
errShare
errSave
NASH: A Simple Unified Framework of Structured Pruning for Accelerating Encoder-Decoder Language Models
err
IF0
err2023-01-01
err0
PREAI
errJongwoo Ko; Seungjoon Park; Yujin Kim; Sumyeong Ahn; Du-Seong Chang; Euijai Ahn; Se-Young Yun
errShare
errSave
A Joint-Training Two-Stage Method For Remote Sensing Image Captioning
err2022-01-01
err20
errOAAI
errYe, Xiutiao; Wang, Shuang; Gu, Yu; Wang, Jihui; Wang, Ruixuan; Hou, Biao; Giunchiglia, Fausto; Jiao, Licheng
errShare
errSave
A ResNet-101 deep learning framework induced transfer learning strategy for moving object detection
err2024-06-01
err4
PREAI
errPanigrahi, Upasana; Sahoo, Prabodh Kumar; Panda, Manoj Kumar; Panda, Ganapati
errShare
errSave
Language Integration in Remote Sensing: Tasks, datasets, and future directions
err2023-12-01
err6
PREAI
errBashmal, Laila; Bazi, Yakoub; Melgani, Farid; Al Rahhal, Mohamad M.; Al Zuair, Mansour Abdulaziz
errShare
errSave
Vision-Language Models in Remote Sensing: Current progress and future trends
err2024-06-01
err11
errOAAI
errLi, Xiang; Wen, Congcong; Hu, Yuan; Yuan, Zhenghang; Zhu, Xiao Xiang
errShare
errSave
researcher View more