arrow
Return

Depth Map Super-Resolution Using Guided Deformable Convolution

delete2021-01-01
delete4
delete
OA
AI
J
Joon-Yeon Kim
S
Seo-Won Ji
S
Seung-Jin Baek *
S
Seung‐Won Jung
S
Sung-Jea Ko
DOI:10.1109/ACCESS.2021.3076853delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Depth maps acquired by low-cost sensors have low spatial resolution, which restricts their usefulness in many image processing and computer vision tasks. To increase the spatial resolution of the depth map, most state-of-the-art depth map super-resolution methods based on deep learning extract the features from a high-resolution guidance image and concatenate them with the features from the depth map. However, such simple concatenation can transfer unnecessary textures, known as texture copying artifacts, of the guidance image to the depth map. To address this problem, we propose a novel depth map super-resolution method using guided deformable convolution. Unlike standard deformable convolution, guided deformable convolution obtains 2D kernel offsets of the depth features from the guidance features. Because the guidance features are not explicitly concatenated with the depth features but are used only to determine the kernel offsets for the depth features, the proposed method can significantly alleviate the texture copying artifacts in the resultant depth map. Experimental results show that the proposed method outperforms the state-of-the-art methods in terms of qualitative and quantitative evaluations.
Keywords:
Convolution
Feature extraction
Kernel
Color
Sensors
Image color analysis
Decoding
Convolutional neural network
depth map
super-resolution
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Access cover
IEEE Access
IF:
3.6
Papers:
9.8W
Citations:
29.4W

Organization

K
Korea University
Scholars:
3.6W
Papers: 3.8W
Citations: 4.4W