返回
Digging into depth-adaptive structure for guided depth super-resolution
DOI:10.1016/j.displa.2024.102752.png)
摘要
En 中文
Depth maps captured by current depth cameras have a lower resolution than RGB images, driving the guided depth super -resolution (GDSR) a prominent research topic. Existing methods usually transfer the structure information of RGB images to guide the restoration of depth maps. However, due to the inherent modality gap, these approaches are prone to introduce spurious edges to the result, known as the RGB texture overtransferred. Therefore, accurate feature representation and selective utilization of RGB structure are two key challenges for GDSR. In this paper, we dig into depth -adaptive structure to address the above issues. We first design a Hybrid Encoder to incorporate the advantages of different network architectures into a unified feature extractor, striking a balance between model efficiency and performance to provide comprehensive high-level semantics. Subsequently, we leverage the high -frequency parts of depth maps to optimize those of RGB images through a cross -modal attention mechanism, effectively filtering out the unreasonable components from redundant textures and yielding depth -adaptive structural features. Finally, we integrate Discrete Cosine Transform (DCT) operations for feature reconstruction, enhancing model interpretability and forming the whole DASNet alongside the aforementioned modules. Experimental results demonstrate that our DASNet achieves quality improvements in both depth maps and synthetic views.
Keyword:
Depth map super-resolution
High-frequency information
Cross-modal attention
Subjective quality
期刊
IF:
3.4
论文数:
2.3K
被引数:
3.2K
机构
引用论文
Prevalence of aortic valve abnormalities in the elderly: An echocardiographic study of a random population sample老年人主动脉瓣异常的患病率: 随机人群样本的超声心动图研究
Magnification-arbitrary depth super-resolution with multiscale consistency deformable alignment*
DISPLAYS
IF3.4
Spectroellipsometric studies on TiN<sub><italic>x</italic></sub> films deposited on glass玻璃上沉积的TiNx薄膜的光谱椭圆偏振研究

