.png){kind=icon}
.png){kind=icon}
Return
3D Surface Highlight Removal Method Based on Detection Mask
.png){kind=icon}
PRE
AI
DOI：10.1007/s13369-025-10573-4.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
The existing stereoscopic methods have shown proficiency in reconstructing objects such as human faces and animals. However, they frequently encounter difficulties in accurately matching complex highlight regions due to information loss. To surmount this challenge, this paper introduces an innovative disparity correction strategy that leverages detection mask technology to effectively mitigate highlight effects. Our method encompasses an end-to-end network consisting of two principal modules: highlight detection and highlight removal. In the highlight detection stage, our approach generates a segmentation mask for highlight regions by analyzing both the input image and the designated region of interest. Following this, the highlight removal stage involves the integration of the original image with the highlight partition mask, utilizing partial convolution to produce an image with reduced highlight effects. Post the stereo matching process, the modified image is compared with the original, illustrating enhanced performance in stereo matching task. To support robust model training and evaluation, we have developed a specialized binocular vision stereo matching dataset that includes nine distinct highlight scenarios. Experimental results corroborate the effectiveness of our proposed method in addressing the challenges associated with highlight-induced matching discrepancies.
Keywords:
Detection mask
3D specular highlight
Specular highlight dataset
Stereoscopic matching
Journal
IF:
5.7
Papers:
4.8K
Citations:
1.1W
View more organizations