arrow
返回

HiMoDepth: Efficient Training-Free High-Resolution On-Device Depth Perception

delete2024-05-01
delete0
PRE
AI
J
Jinrui Zhang
H
Huan Yang
Ju Ren 封面图
Ju Ren (Ju Ren)
D
Deyu Zhang *
B
Bangwen He
Y
Youngki Lee
T
Ting Cao
Y
Yuanchun Li
Y
Yaoxue Zhang
Y
Yunxin Liu *
DOI:10.1109/TMC.2023.3294188delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
High-resolution depth estimation, with a minimum resolution of 1280 x 960, is essential for achieving more immersive experiences in on-device 3D vision applications. However, implementing high-resolution solutions on resource-limited mobile devices presents significant challenges, such as the need for additional expensive depth sensors, computation-intensive machine learning models requiring large-scale datasets, or the need for device motion while the target object remains stationary. In this study, we propose HiMoDepth, an efficient training-free high-resolution depth estimation system that utilizes widely-available on-device dual cameras. HiMoDepth consists of two modules: 1) homogenizing the on-device heterogeneous cameras by iteratively cropping the Field-of-Views to make the focal length of the cameras equal and filtering out the out-of-sync frames based on time stamps, and 2) designing a hierarchical mobile GPU-friendly stereo matching method that effectively reduces the latency of stereo matching with high-resolution depth maps by using efficient data layout, reducing the number of memory accesses, and searching the corresponding pixel over a coarse-to-fine hierarchy. We implement HiMoDepth on multiple commodity mobile devices and conduct comprehensive evaluations. Experimental results show that HiMoDepth significantly outperforms the baselines in both accuracy and running speed on mobile devices that support high-resolution depth maps.
Keyword:
Efficient
high-resolution
heterogeneous cameras
mobile device

期刊

IEEE Transactions on Mobile Computing 封面图
IEEE Transactions on Mobile Computing
IF:
9.2
论文数:
5.8K
被引数:
1.8W

机构

T
tsinghua university
学者数:
11.9W
论文数: 10.0W
被引数: 137
C
Central South University
学者数:
10.0W
论文数: 7.2W
被引数: 10.9W
M
Microsoft
学者数:
3.0K
论文数: 2.7K
被引数: 7
S
seoul national university (snu)
学者数:
7.2W
论文数: 6.6W
被引数: 86
学者 查看更多机构
引用论文

引用论文

Retromer localizes to autophagosomes during HCV replication
err2017-04-13
err0
errOAAI
errPeiqi Yin; Zhi Hong; Leiliang Zhang; Youyang Ke
err分享
err收藏
Bubblestorm
err2007-08-27
err0
PREAI
errWesley W. Terpstra; Jussi Kangasharju; Christof Leng; Alejandro P. Buchmann
err分享
err收藏
Hepatocyte Growth Factor in Polymorphonuclear Leukocytes Is Increased in Patients with Systemic Inflammatory Response Syndrome
err2004-02-01
err0
PREAI
errAsako Matsushima; Hiroshi Ogura; Taichin Koh; Kieko Fujita; Kazuhisa Yoshiya; Yuka Sumi; Hideo Hosotsubo; Yasuyuki Kuwagata; Hiroshi Tanaka; Takeshi Shimazu; Hisashi Sugimoto
err分享
err收藏
err分享
err收藏
err分享
err收藏
Safety of concomitant therapy with radium‐223 and abiraterone or enzalutamide in a real‐world population
err2021-03-11
err0
PREAI
errHanson Zhao; Lauren E. Howard; Amanda M. De Hoedt; Martha K. Terris; Christopher L. Amling; Christopher J. Kane; Matthew R. Cooperberg; William J. Aronson; Zachary Klaassen; Thomas J. Polascik; Adriana C. Vidal; Stephen J. Freedland
err分享
err收藏
学者 查看更多内容