arrow
返回

RGB-D-Based Stair Detection and Estimation Using Deep Learning

delete2023-02-15
delete6
delete
OA
AI
C
Chen Wang
Z
Zhongcai Pei
S
Shuang Qiu
Z
Zhiyong Tang *
DOI:10.3390/s23042175delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Stairs are common vertical traffic structures in buildings, and stair detection tasks are important in environmental perception for autonomous mobile robots. Most existing algorithms have difficulty combining the visual information from binocular sensors effectively and ensuring reliable detection at night and in the case of extremely fuzzy visual clues. To solve these problems, we propose a stair detection network with red-green-blue (RGB) and depth inputs. Specifically, we design a selective module, which can make the network learn the complementary relationship between the RGB feature maps and the depth feature maps and fuse the features effectively in different scenes. In addition, we propose several postprocessing algorithms, including a stair line clustering algorithm and a coordinate transformation algorithm, to obtain the stair geometric parameters. Experiments show that our method has better performance than existing the state-of-the-art deep learning method, and the accuracy, recall, and runtime are improved by 5.64%, 7.97%, and 3.81 ms, respectively. The improved indexes show the effectiveness of the multimodal inputs and the selective module. The estimation values of stair geometric parameters have root mean square errors within 15 mm when ascending stairs and 25 mm when descending stairs. Our method also has extremely fast detection speed, which can meet the requirements of most real-time applications.
Keyword:
stair detection
RGB-D
deep learning
multimodality
stair geometric parameter estimation
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Sensors 封面图
Sensors
IF:
3.5
论文数:
7.2W
被引数:
20.9W

机构

B
Beihang University
学者数:
5.2W
论文数: 4.1W
被引数: 37
引用论文

引用论文

The Relation Between Mean Arterial Pressure and Cardiac Index in Major Abdominal Surgery Patients: A Prospective Observational Cohort Study
err2021-12-02
err0
PREAI
errKarim Kouz; Alina Bergholz; Lea M. Timmermann; Lennart Brockmann; Moritz Flick; Phillip Hoppe; Luisa Briesenick; Leonie Schulte-Uentrop; Linda Krause; Kamal Maheshwari; Daniel I. Sessler; Bernd Saugel
err分享
err收藏
Synthesis of n-type semiconducting diamond film using diphosphorus pentaoxide as the doping source以五氧化二磷为掺杂源合成n型半导体金刚石膜
err1990-10-01
err0
PREAI
errKen Okano; Hideo Kiyota; Tatsuya Iwasaki; Yoshitaka Nakamura; Yukio Akiba; Tateki Kurosu; Masamori Iida; Terutaro Nakamura
err分享
err收藏
err分享
err收藏
Deep leaning-based ultra-fast stair detection
err2022-09-27
err9
errOAAI
errWang, Chen; Pei, Zhongcai; Qiu, Shuang; Tang, Zhiyong
err分享
err收藏
Photocatalytic N2 fixation using chalcogenide-based nanomaterials
err2021-01-01
err0
PREAI
errYasser Mahmoud A. Mohamed; Hossam A. El Nazer; Elzahraa A. Elgohery; Mohammad Mansoob Khan
err分享
err收藏
Cohort profile: Bandar Kong prospective study of chronic non-communicable diseases队列概况:Bandar Kong慢性非传染性疾病前瞻性研究
err2022-05-12
err0
errOAAI
errAzim Nejatizadeh; Ebrahim Eftekhar; Mohammad Shekari; Hossein Farshidi; Seyed Hossein Davoodi; Mehdi Shahmoradi; Hossein Poustchi; Amin Ghanbarnejad; Teymour Aghamolaei; Hadi Yousefi; Shideh Rafati
err分享
err收藏
The potential oncogenic activity of influenza A virus in lungs of mice甲型流感病毒在鼠肺中的潜在致癌活性
err1984-01-01
err0
PREAI
errL.W. Chang; J.H. Menna; P.M. Wang; A.E. Kalderon; J.R.J. Sorenson; D.E. Wennerstrom
err分享
err收藏
学者 查看更多内容