Heterogeneous Binary Pixel Difference Networks for Remote Sensing Object Detection

Jialei Zhan

doi:10.1109/TGRS.2024.3520161

Heterogeneous Binary Pixel Difference Networks for Remote Sensing Object Detection

2025-01-01

1

PRE

AI

DOI：10.1109/TGRS.2024.3520161

Original

Original request for help

Save

Abstract

En 中文

Recent research in remote sensing object detection (RSOD) has significantly advanced the development of vision foundation models. However, deploying these models on resource-constrained edge devices is challenging due to their high computational demands. Binarized detectors utilize binary neural networks (BNNs) to achieve extreme compression by quantizing weights and activations to +1 or -1, which have been extensively studied for generic object detection tasks. In remote sensing images, the objects of interest typically exhibit weak responses, and the images often contain numerous unique local areas. Feature binarization in these images can lead to substantial loss of object contrast and scale prior information, which exacerbates performance issues, particularly for small objects, resulting in significant performance degradation. To address these challenges, we propose a novel binarized detector for RSOD named the heterogeneous binary pixel difference network (HBiPiDiNet). Initially, we developed a binary pixel difference convolution (BiPDC) that integrates local binary patterns (LBPs) to capture local contrast information with traditional binary convolution, thereby enhancing the representation of small objects. Subsequently, we constructed heterogeneous kernel fusion convolution blocks (HKFCB) based on BiPDC and standard binary convolution. The HKFCB comprises multiple BiPDCs at different scales, effectively representing BiPDC under multiscale LBP and multiscale binary convolutions. Extensive experiments demonstrate that our proposed method significantly enhances the performance of state-of-the-art binary detection methods across three remote sensing datasets: AI-TOD, VisDrone2019, and DIOR. We have released our code and models at https://github.com/yuhua666/HBiPiDiNet/tree/main.

Keywords:

Remote sensing

Feature extraction

Object detection

Detectors

Convolution

Computational modeling

Kernel

Image edge detection

Accuracy

Quantization (signal)

Binarization

binary neural networks (BNNs)

local binary patterns (LBPs)

object detectors

remote sensing

Heterogeneous Binary Pixel Difference Networks for Remote Sensing Object Detection

Abstract

Journal

Organization