arrow
返回

NDNet: Narrow While Deep Network for Real-Time Semantic Segmentation

delete2021-09-01
delete32
delete
OA
AI
Z
Zhengeng Yang
余
余洪山 (Hongshan Yu) *
Q
Qiang Fu
孙伟杰 封面图
孙伟杰 (Wei Sun)
W
Wenyan Jia
M
Mingui Sun
Z
Zhi‐Hong Mao
DOI:10.1109/TITS.2020.2987816delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
The rapid development of autonomous driving in recent years presents many challenges for scene understanding. As an essential step towards scene understanding, semantic segmentation has received increased attention in the past few years. Although deep learning based approaches have achieved great success in improving the segmentation accuracy, most of them suffer from an inefficiency problem and can hardly be applied to real-time applications. In this paper, we analyze the computational cost of Convolutional Neural Network (CNN) and find that the inefficiency of CNNs is mainly caused by their wide structure rather than deep structure. In addition, the success of pruning based model compression methods proves that there are many redundant channels in CNNs. Thus, we design a narrow while deep backbone network to improve the efficiency of semantic segmentation. By casting our network to fully convolutional network (FCN32) segmentation architecture, the basic structure of most segmentation methods, we achieve 61.5% mIoU on Cityscapes validation dataset with only 4.2G floating-point operations (FLOPs) on 1024 x 2048 inputs, which already outperforms one of the earliest real-time deep learning based segmentation methods: ENet (58.3% mIoU, 3.8G FLOPs on 640x360 inputs). By further refining the output resolution of our network to the 1/8 of the input resolution with a simple encoder-decoder structure, we achieve 65.3% mIoU on Cityscapes test set with 14.0G FLOPs and 39.9 frames per second (FPS) on Titan X card. We have made our model publicly available at https://github.com/zgyang-hnu/NDNet.
Keyword:
Semantic segmentation
autonomous driving
real-time
deep learning

期刊

IEEE Transactions on Intelligent Transportation Systems 封面图
IEEE Transactions on Intelligent Transportation Systems
IF:
8.4
论文数:
9.7K
被引数:
6.3W

机构

U
University of Pittsburgh
学者数:
4.5W
论文数: 3.6W
被引数: 7.1W
H
hunan university
学者数:
4.5W
论文数: 3.3W
被引数: 70
引用论文

引用论文

Methods and datasets on semantic segmentation: A review
err2018-08-01
err189
PREAI
errYu, Hongshan; Yang, Zhengeng; Tan, Lei; Wang, Yaonan; Sun, Wei; Sun, Mingui; Tang, Yandong
err分享
err收藏
Allele-Specific HLA Loss and Immune Escape in Lung Cancer Evolution
errCell
IF0
err2017-11-01
err0
errOAAI
errNicholas McGranahan; Rachel Rosenthal; Crispin T. Hiley; Andrew J. Rowan; Thomas B.K. Watkins; Gareth A. Wilson; Nicolai J. Birkbak; Selvaraju Veeriah; Peter Van Loo; Javier Herrero; Charles Swanton; Charles Swanton; Mariam Jamal-Hanjani; Selvaraju Veeriah; Seema Shafi; Justyna Czyzewska-Khan; Diana Johnson; Joanne Laycock; Leticia Bosshard-Carter; Rachel Rosenthal; Pat Gorman; Robert E. Hynds; Gareth Wilson; Nicolai J. Birkbak; Thomas B.K. Watkins; Nicholas McGranahan; Stuart Horswell; Richard Mitter; Mickael Escudero; Aengus Stewart; Peter Van Loo; Andrew Rowan; Hang Xu; Samra Turajlic; Crispin Hiley; Christopher Abbosh; Jacki Goldman; Richard Kevin Stone; Tamara Denner; Nik Matthews; Greg Elgar; Sophia Ward; Marta Costa; Sharmin Begum; Ben Phillimore; Tim Chambers; Emma Nye; Sofia Graca; Maise Al Bakir; Kroopa Joshi; Andrew Furness; Assma Ben Aissa; Yien Ning Sophia Wong; Andy Georgiou; Sergio Quezada; John A. Hartley; Helen L. Lowe; Javier Herrero; David Lawrence; Martin Hayward; Nikolaos Panagiotopoulos; Shyam Kolvekar; Mary Falzon; Elaine Borg; Teresa Marafioti; Celia Simeon; Gemma Hector; Amy Smith; Marie Aranda; Marco Novelli; Dahmane Oukrif; Sam M. Janes; Ricky Thakrar; Martin Forster; Tanya Ahmad; Siow Ming Lee; Dionysis Papadatos-Pastos; Dawn Carnell; Ruheena Mendes; Jeremy George; Neal Navani; Asia Ahmed; Magali Taylor; Junaid Choudhary; Yvonne Summers; Raffaele Califano; Paul Taylor; Rajesh Shah; Piotr Krysiak; Kendadai Rammohan; Eustace Fontaine; Richard Booton; Matthew Evison; Phil Crosbie; Stuart Moss; Faiza Idries; Leena Joseph; Paul Bishop; Anshuman Chaturved; Anne Marie Quinn; Helen Doran; Angela Leek; Phil Harrison; Katrina Moore; Rachael Waddington; Juliette Novasio; Fiona Blackhall; Jane Rogan; Elaine Smith; Caroline Dive; Jonathan Tugwood; Ged Brady; Dominic G. Rothwell; Francesca Chemi; Jackie Pierce; Sakshi Gulati; Babu Naidu; Gerald Langman; Simon Trotter; Mary Bellamy; Hollie Bancroft; Amy Kerr; Salma Kadiri; Joanne Webb; Gary Middleton; Madava Djearaman; Dean Fennell; Jacqui A. Shaw; John Le Quesne; David Moore; Apostolos Nakas; Sridhar Rathinam; William Monteiro; Hilary Marshall; Louise Nelson; Jonathan Bennett; Joan Riley; Lindsay Primrose; Luke Martinson; Girija Anand; Sajid Khan; Anita Amadi; Marianne Nicolson; Keith Kerr; Shirley Palmer; Hardy Remmen; Joy Miller; Keith Buchan; Mahendran Chetty; Lesley Gomersall; Jason Lester; Alison Edwards; Fiona Morgan; Haydn Adams; Helen Davies; Malgorzata Kornaszewska; Richard Attanoos; Sara Lock; Azmina Verjee; Mairead MacKenzie; Maggie Wilcox; Harriet Bell; Allan Hackshaw; Yenting Ngai; Sean Smith; Nicole Gower; Christian Ottensmeier; Serena Chee; Benjamin Johnson; Aiman Alzetani; Emily Shaw; Eric Lim; Paulo De Sousa; Monica Tavares Barbosa; Alex Bowman; Simon Jordan; Alexandra Rice; Hilgardt Raubenheimer; Chiara Proli; Maria Elena Cufari; John Carlo Ronquillo; Angela Kwayie; Harshil Bhayani; Morag Hamilton; Yusura Bakar; Natalie Mensah; Lyn Ambrose; Anand Devaraj; Silviu Buderi; Jonathan Finch; Leire Azcarate; Hema Chavan; Sophie Green; Hillaria Mashinga; Andrew G. Nicholson; Kelvin Lau; Michael Sheaff; Peter Schmid; John Conibear; Veni Ezhil; Babikir Ismail; Melanie Irvin-sellers; Vineet Prakash; Peter Russell; Teresa Light; Tracey Horey; Sarah Danson; Jonathan Bury; John Edwards; Jennifer Hill; Sue Matthews; Yota Kitsanta; Kim Suvarna; Patricia Fisher; Allah Dino Keerio; Michael Shackcloth; John Gosney; Pieter Postmus; Sarah Feeney; Julius Asante-Siaw; Hugo J.W.L. Aerts; Stefan Dentro; Christophe Dessimoz
err分享
err收藏
Locally Shared Features: An Efficient Alternative to Conditional Random Field for Semantic Segmentation
err2019-01-01
err7
errOAAI
errYang, Zhengeng; Yu, Hongshan; Sun, Wei; Mao, Zhihong; Sun, Mingui
err分享
err收藏
学者 查看更多内容