arrow
返回

Lightweight Monocular Depth Estimation on Edge Devices

delete2022-09-01
delete12
PRE
AI
S
Siping Liu
L
Laurence T. Yang *
X
Xiaohan Tu *
李仁发 封面图
李仁发 (Renfa Li) *
C
Cheng Xu
DOI:10.1109/JIOT.2022.3151374delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Given monocular images as inputs, monocular depth estimation (MDE) infers pixel-level depth. MDE is always a critical stage in scene sensing on edge devices. Existing MDE studies frequently employ deep neural networks (DNNs) for MDE, but they still face some problems, such as sacrificing computational complexity and efficiency in return for great precision, or losing more precision in exchange for increased efficiency. To alleviate these issues; 1) we propose an encoder-decoder network (EdgeNet) for precise and fast MDE on different edge devices. When recovering depth in the decoder, we design upsampling modules to aggregate global depth information with low computational complexity, improving the accuracy of the decoder by extracting its different ranges of depth information; 2) we develop a two-stage channel pruning method to, respectively, prune the encoder and decoder based on their characteristics. Our pruning method further reduces latency and model/computational complexity of EdgeNet, while losing little accuracy; and 3) we optimize the pruned EdgeNet to decrease graphics processing unit (GPU) scheduling overhead. The optimization accelerates MDE inference by an order of magnitude on the TX2 GPU device, when the input resolution is 224 x 224. Extensive experiments show that our strategies are effective on different edge GPU devices, when input resolutions differ in outdoor or indoor scenes. For example, compared with the state of the art, the optimized EdgeNet, respectively, reduces the GPU latency by 76.3% and 89.2% on Nano and TX2 GPU devices with 2.6% lower root mean square error when the input resolution is 128 x 416.
Keyword:
Channel pruning
deep neural networks (DNNs)
monocular depth estimation (MDE)
scheduling optimization

期刊

IEEE Internet of Things Journal 封面图
IEEE Internet of Things Journal
IF:
8.9
论文数:
1.4W
被引数:
7.8W

机构

R
railway police college
学者数:
37
论文数: 36
被引数: 0
S
saint francis xavier university - canada
学者数:
761
论文数: 911
被引数: 0
H
hunan university
学者数:
4.5W
论文数: 3.3W
被引数: 70
学者 查看更多机构
引用论文

引用论文

err分享
err收藏
Metabolic engineering of microbial competitive advantage for industrial fermentation processes
err2016-08-05
err0
errOAAI
errA. Joe Shaw; Felix H. Lam; Maureen Hamilton; Andrew Consiglio; Kyle MacEwen; Elena E. Brevnova; Emily Greenhagen; W. Greg LaTouf; Colin R. South; Hans van Dijken; Gregory Stephanopoulos
err分享
err收藏
err分享
err收藏
err
IF0
err
err0
PREAI
err
err分享
err收藏
Acute focal demyelinating disease simulating brain tumors: Histopathologic guidelines for an accurate diagnosis
err2001-03-01
err0
PREAI
errYasuo Sugita; Mizuhiko Terasaki; Minoru Shigemori; Kiyohiko Sakata; Minoru Morimatsu
err分享
err收藏
学者 查看更多内容