arrow
Return

PRNet: Parallel Reinforcement Network for two-view correspondence learning

delete2025-02-01
delete0
PRE
AI
K
Kang Zheng
赖桃桃 (Taotao Lai) *
李佐勇 cover
李佐勇 (Zuoyong Li)
L
Lifang Wei
R
Riqing Chen
DOI:10.1016/j.knosys.2025.112978delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Two-view correspondence learning is a fundamental task in computer vision for locating the same object across two different images, and its essence lies in capturing the context from the images. Recent studies employ the standard Convolutional Neural Network (CNN) as the core architecture to capture the context. However, the inherent nature of the CNN's local receptive field and pooling operations can result in the loss of certain semantic context. This can result in the CNN-based correspondence learning methods having an insufficient understanding of the global context, especially on image pairs including challenges like significant viewpoint changes, repetitive structures and weak textures. To address this issue and these challenges, we propose a novel correspondence learning method called Parallel Reinforcement Network (PRNet). Firstly, we design a reinforcement injection block, not only to dynamically refine feature weights by using channel attention mechanism, but also to preserve important details for alleviating over-smoothing issue by strengthening the network's capacity. Secondly, to alleviate the potential issue of overlooking the weak local context by CNN, we propose a parallel fusion block to integrate both shallow and deep features, preserving local details and enhancing global context. We evaluate the performance of the proposed PRNet on an outlier rejection task and a relative pose estimation task. The experimental results demonstrate the proposed PRNet exceeds several existing state-of-the-art methods in various challenging scenarios.
Keywords:
Two-view correspondence
Channel attention mechanism
Parallel fusion
Pose estimation
Outlier rejection

Journal

K
Knowledge-Based Systems
IF:
7.6
Papers:
1.2W
Citations:
4.5W

Organization

F
Fujian Agriculture and Forestry University
Scholars:
8.5K
Papers: 2.2K
Citations: 1.8W