arrow
Return

GRADE: A Generalization Robustness Assessment via Distributional Evaluation for Remote Sensing Object Detection

delete2025-11-20
delete0
delete
OA
AI
D
Decheng Wang
Y
Yi Zhang
B
Baocun Bai
X
Xiao Yu *
X
Xiangbo Shu
Y
Yimian Dai
DOI:10.3390/rs17223771delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
The performance of remote sensing object detectors often degrades severely when deployed in new operational environments due to covariate shift in the data distribution. Existing evaluation paradigms, which primarily rely on aggregate performance metrics such as mAP, generally lack the analytical depth to provide insights into the mechanisms behind such generalization failures. To fill this critical gap, we propose the GRADE (Generalization Robustness Assessment via Distributional Evaluation) framework, a multi-dimensional, systematic methodology for assessing model robustness. The framework quantifies shifts in background context and object-centric features through a hierarchical analysis of distributional divergence, utilizing Scene-level Fréchet Inception Distance (FID) and Instance-level FID, respectively. These divergence measures are systematically integrated with a standardized performance decay metric to form a unified, adaptively weighted Generalization Score (GS). This composite score serves not only as an evaluation tool but also as a powerful analytical tool, enabling the fine-grained attribution of performance loss to specific sources of domain shift—whether originating from scene variations or anomalies in object appearance. Compared to conventional single-dimensional evaluation methods, the GRADE framework offers enhanced interpretability, a standardized evaluation protocol, and reliable cross-model comparability, establishing a principled theoretical foundation for cross-domain generalization assessment. Extensive empirical validation on six mainstream remote sensing benchmark datasets and multiple state-of-the-art detection models demonstrates that the model rankings produced by the GRADE framework exhibit high fidelity to real-world performance, thereby effectively quantifying and explaining the cross-domain generalization penalty.
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Remote Sensing cover
Remote Sensing
IF:
4.1
Papers:
6.9K
Citations:
15.1W

Organization

N
Nanjing University of Science and Technology
Scholars:
5.6K
Papers: 2.2K
Citations: 25
E
equipment project management center
Scholars:
1
Papers: 1
Citations: 0
N
nankai university
Scholars:
4.7W
Papers: 3.2W
Citations: 74
researcher View more organizations