返回
Robust Scene Parsing by Mining Supportive Knowledge From Dataset
DOI:10.1109/TNNLS.2021.3107194.png)
摘要
En 中文
Scene parsing, or semantic segmentation, aims at labeling all pixels in an image with the predefined categories of things and stuff. Learning a robust representation for each pixel is crucial for this task. Existing state-of-the-art (SOTA) algorithms employ deep neural networks to learn (discover) the representations needed for parsing from raw data. Nevertheless, these networks discover desired features or representations only from the given image (content), ignoring more generic knowledge contained in the dataset. To overcome this deficiency, we make the first attempt to explore the meaningful supportive knowledge, including general visual concepts (i.e., the generic representations for objects and stuff) and their relations from the whole dataset to enhance the underlying representations of a specific scene for better scene parsing. Specifically, we propose a novel supportive knowledge mining module (SKMM) and a knowledge augmentation operator (KAO), which can be easily plugged into modern scene parsing networks. By taking image-specific content and dataset-level supportive knowledge into full consideration, the resulting model, called knowledge augmented neural network (KANN), can better understand the given scene and provide greater representational power. Experiments are conducted on three challenging scene parsing and semantic segmentation datasets: Cityscapes, Pascal-Context, and ADE20K. The results show that our KANN is effective and achieves better results than all existing SOTA methods.
Keyword:
Visualization
Semantics
Knowledge engineering
Training
Atomic layer deposition
Task analysis
Feature extraction
Graph neural network
memory network
scene parsing
期刊
IF:
8.9
论文数:
7.6K
被引数:
7.2W
机构
引用论文
Wider or Deeper: Revisiting the ResNet Model for Visual Recognition更广泛或更深入: 重新审视视觉识别的ResNet模型
PATTERN RECOGNITION
IF7.6
In vitro and in vivo binding of neuroactive steroids to the sigma‐1 receptor as measured with the positron emission tomography radioligand [18F]FPS
Synapse
IF0
Recent Development of Dual-Dictionary Learning Approach in Medical Image Analysis and Reconstruction

