arrow
返回

Robust Scene Parsing by Mining Supportive Knowledge From Dataset

delete2023-05-01
delete3
PRE
AI
A
Ao Luo
F
Fan Yang
X
Xin Li *
Y
Yuezun Li
Z
Zhicheng Jiao
程
程洪 (Hong Cheng)
S
Siwei Lyu
DOI:10.1109/TNNLS.2021.3107194delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Scene parsing, or semantic segmentation, aims at labeling all pixels in an image with the predefined categories of things and stuff. Learning a robust representation for each pixel is crucial for this task. Existing state-of-the-art (SOTA) algorithms employ deep neural networks to learn (discover) the representations needed for parsing from raw data. Nevertheless, these networks discover desired features or representations only from the given image (content), ignoring more generic knowledge contained in the dataset. To overcome this deficiency, we make the first attempt to explore the meaningful supportive knowledge, including general visual concepts (i.e., the generic representations for objects and stuff) and their relations from the whole dataset to enhance the underlying representations of a specific scene for better scene parsing. Specifically, we propose a novel supportive knowledge mining module (SKMM) and a knowledge augmentation operator (KAO), which can be easily plugged into modern scene parsing networks. By taking image-specific content and dataset-level supportive knowledge into full consideration, the resulting model, called knowledge augmented neural network (KANN), can better understand the given scene and provide greater representational power. Experiments are conducted on three challenging scene parsing and semantic segmentation datasets: Cityscapes, Pascal-Context, and ADE20K. The results show that our KANN is effective and achieves better results than all existing SOTA methods.
Keyword:
Visualization
Semantics
Knowledge engineering
Training
Atomic layer deposition
Task analysis
Feature extraction
Graph neural network
memory network
scene parsing

期刊

IEEE Transactions on Neural Networks and Learning Systems 封面图
IEEE Transactions on Neural Networks and Learning Systems
IF:
8.9
论文数:
7.6K
被引数:
7.2W

机构

U
university of pennsylvania
学者数:
9.2W
论文数: 7.8W
被引数: 153
S
state university of new york (suny) system
学者数:
6.5W
论文数: 5.8W
被引数: 65
U
university at buffalo, suny
学者数:
1.2W
论文数: 9.5K
被引数: 9
O
ocean university of china
学者数:
3.1W
论文数: 2.0W
被引数: 21
学者 查看更多机构
引用论文

引用论文

A Pilot Study of the Efficacy of the Unified Protocol for Transdiagnostic Treatment of Emotional Disorders in Treating Posttraumatic Psychopathology: A Randomized Controlled Trial
err2021-01-16
err0
errOAAI
errMeaghan L. O'Donnell; Winnie Lau; Katherine Chisholm; James Agathos; Jonathon Little; Sonia Terhaag; Rachel Brand; Andrea Putica; Alexander C. N. Holmes; Lynda Katona; Kim L. Felmingham; Kim Murray; Fardous Hosseiny; Matthew W. Gallagher
err分享
err收藏
A method of detecting the orientation of aligned components
err1986-04-01
err0
PREAI
errAkihide Hashizume; Pen-Shu Yeh; Azriel Rosenfeld
err分享
err收藏
学者 查看更多内容