arrow
返回

Exploiting Motion Perception in Depth Estimation Through a Lightweight Convolutional Neural Network

delete2021-01-01
delete16
delete
OA
AI
P
Pedro Nuno Leite *
A
Andry Maykol Pinto
DOI:10.1109/ACCESS.2021.3082697delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Understanding the surrounding 3D scene is of the utmost importance for many robotic applications. The rapid evolution of machine learning techniques has enabled impressive results when depth is extracted from a single image. High-latency networks are required to achieve these performances, rendering them unusable for time-constrained applications. This article introduces a lightweight Convolutional Neural Network (CNN) for depth estimation, NEON, designed for balancing both accuracy and inference times. Instead of solely focusing on visual features, the proposed methodology exploits the Motion-Parallax effect to combine the apparent motion of pixels with texture. This research demonstrates that motion perception provides crucial insight about the magnitude of movement for each pixel, which also encodes cues about depth since large displacements usually occur when objects are closer to the imaging sensor. NEON's performance is compared to relevant networks in terms of Root Mean Squared Error (RMSE), the percentage of correctly predicted pixels (delta(1)) and inference times, using the KITTI dataset. Experiments prove that NEON is significantly more efficient than the current top ranked network, estimating predictions 12 times faster; while achieving an average RMSE of 3.118 m and a delta(1) of 94.5%. Ablation studies demonstrate the relevance of tailoring the network to use motion perception principles in estimating depth from image sequences, considering that the effectiveness and quality of the estimated depth map is similar to more computational demanding state-of-the-art networks. Therefore, this research proposes a network that can be integrated in robotic applications, where computational resources and processing-times are important constraints, enabling tasks such as obstacle avoidance, object recognition and robotic grasping.
Keyword:
CNN
depth estimation
mobile robotics
motion perception
parallax
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Access 封面图
IEEE Access
IF:
3.6
论文数:
9.8W
被引数:
29.4W

机构

I
INESC TEC
学者数:
1.5K
论文数: 1.4K
被引数: 1.7K
引用论文

引用论文

Judgment Capacity, Fear of Falling, and the Risk of Falls in Community-Dwelling Older Adults: The Progetto Veneto Anziani Longitudinal Study社区居住的老年人的判断能力,对跌倒的恐惧和跌倒的风险: Progetto Veneto Anziani纵向研究
err2020-06-01
err0
errOAAI
errCaterina Trevisan; Bruno M. Zanforlini; Stefania Maggi; Marianna Noale; Federica Limongi; Marina De Rui; Maria Chiara Corti; Egle Perissinotto; Anna-Karin Welmer; Enzo Manzato; Giuseppe Sergi
err分享
err收藏
Metabolic engineering of microbial competitive advantage for industrial fermentation processes
err2016-08-05
err0
errOAAI
errA. Joe Shaw; Felix H. Lam; Maureen Hamilton; Andrew Consiglio; Kyle MacEwen; Elena E. Brevnova; Emily Greenhagen; W. Greg LaTouf; Colin R. South; Hans van Dijken; Gregory Stephanopoulos
err分享
err收藏
Synthesis of n-type semiconducting diamond film using diphosphorus pentaoxide as the doping source以五氧化二磷为掺杂源合成n型半导体金刚石膜
err1990-10-01
err0
PREAI
errKen Okano; Hideo Kiyota; Tatsuya Iwasaki; Yoshitaka Nakamura; Yukio Akiba; Tateki Kurosu; Masamori Iida; Terutaro Nakamura
err分享
err收藏
Ontop-spatial: Ontop of geospatial databases
err2019-10-01
err0
PREAI
errKonstantina Bereta; Guohui Xiao; Manolis Koubarakis
err分享
err收藏
MARESye: A hybrid imaging system for underwater robotic applications
err2020-03-01
err49
errOAAI
errPinto, Andry Maykol; Matos, Anibal C.
err分享
err收藏
Critical facility accessibility and road criticality assessment considering flood-induced partial failure
err2022-11-25
err0
errOAAI
errUtkarsh Gangwal; A. R. Siders; Jennifer Horney; Holly A. Michael; Shangjia Dong
err分享
err收藏
学者 查看更多内容