Dynamic multi-scale loss optimization for object detection

Yihao Luo

doi:10.1007/s11042-022-13164-9

Dynamic multi-scale loss optimization for object detection

2022-06-23

1

PRE

AI

DOI：10.1007/s11042-022-13164-9

Original

Original request for help

Save

Abstract

En 中文

With the continuous improvement of deep object detectors via advanced model architectures, imbalance problems in the training process have received more attention. It is a common paradigm in object detection frameworks to perform multi-scale detection. However, each scale is treated equally during training. In this paper, we carefully study the objective imbalance of multi-scale detector training. We argue that the loss in each scale level is neither equally important nor independent. Different from the existing solutions of setting multi-task weights, we dynamically optimize the loss weight of each scale level in the training process. Specifically, we propose an Adaptive Variance Weighting (AVW) to balance multi-scale loss according to the statistical variance. Then we develop a novel Reinforcement Learning Optimization (RLO) to decide the weighting scheme probabilistically during training. It makes better utilization of multi-scale training loss without extra computational complexity and learnable parameters for backpropagation. Without bells and whistles, the proposed method improves ATSS by 0.9 AP on the MS COCO benchmark. And it achieves 82.1 mAP on Pascal VOC 2007 test set, which outperforms other reinforcement-learning-based methods.

Keywords:

Object detection

Multi-scale imbalance

Reinforcement learning

Multi-task

Dynamic multi-scale loss optimization for object detection

Abstract

Journal

Organization