arrow
返回

Digging into depth-adaptive structure for guided depth super-resolution

delete2024-09-01
delete0
PRE
AI
Y
Yue Hou
聂浪 封面图
聂浪 (Lang Nie)
林
林春雨 (Chunyu Lin) *
B
Baoqing Guo
赵
赵耀 (Yao Zhao)
DOI:10.1016/j.displa.2024.102752delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Depth maps captured by current depth cameras have a lower resolution than RGB images, driving the guided depth super -resolution (GDSR) a prominent research topic. Existing methods usually transfer the structure information of RGB images to guide the restoration of depth maps. However, due to the inherent modality gap, these approaches are prone to introduce spurious edges to the result, known as the RGB texture overtransferred. Therefore, accurate feature representation and selective utilization of RGB structure are two key challenges for GDSR. In this paper, we dig into depth -adaptive structure to address the above issues. We first design a Hybrid Encoder to incorporate the advantages of different network architectures into a unified feature extractor, striking a balance between model efficiency and performance to provide comprehensive high-level semantics. Subsequently, we leverage the high -frequency parts of depth maps to optimize those of RGB images through a cross -modal attention mechanism, effectively filtering out the unreasonable components from redundant textures and yielding depth -adaptive structural features. Finally, we integrate Discrete Cosine Transform (DCT) operations for feature reconstruction, enhancing model interpretability and forming the whole DASNet alongside the aforementioned modules. Experimental results demonstrate that our DASNet achieves quality improvements in both depth maps and synthetic views.
Keyword:
Depth map super-resolution
High-frequency information
Cross-modal attention
Subjective quality

期刊

Displays 封面图
Displays
IF:
3.4
论文数:
2.3K
被引数:
3.2K

机构

B
Beijing Jiaotong University
学者数:
2.2W
论文数: 1.7W
被引数: 1.2W
引用论文

引用论文

From Pairwise Comparisons and Rating to a Unified Quality Scale
err2020-01-01
err39
errOAAI
errPerez-Ortiz, Maria; Mikhailiuk, Aliaksei; Zerman, Emin; Hulusic, Vedad; Valenzise, Giuseppe; Mantiuk, Rafal K.
err分享
err收藏
err分享
err收藏
High-Resolution Depth Maps Imaging via Attention-Based Hierarchical Multi-Modal Fusion
err2022-01-01
err30
errOAAI
errZhong, Zhiwei; Liu, Xianming; Jiang, Junjun; Zhao, Debin; Chen, Zhiwen; Ji, Xiangyang
err分享
err收藏
err分享
err收藏
err分享
err收藏
Soil Reinforcement Using Recycled Plastic Waste for Sustainable Pavements
err2018-10-28
err0
PREAI
errMuhammad Hafez; Rabah Mousa; Ahmed Awed; Sherif El-Badawy
err分享
err收藏
Early contribution of oxidative glycation in Alzheimer disease
err1996-10-01
err0
PREAI
errMark A. Smith; Massimo Tabaton; George Perry
err分享
err收藏
学者 查看更多内容