arrow
Return

Visual Semantic Segmentation Based on Few/Zero-Shot Learning: An Overview

delete2024-05-01
delete19
delete
OA
AI
任文琦 cover
任文琦 (Wenqi Ren)
Y
Yang Tang *
Q
Qiyu Sun
C
Chaoqiang Zhao
Q
Qing‐Long Han *
DOI:10.1109/JAS.2023.123207delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Visual semantic segmentation aims at separating a visual sample into diverse blocks with specific semantic attributes and identifying the category for each block, and it plays a crucial role in environmental perception. Conventional learning-based visual semantic segmentation approaches count heavily on large-scale training data with dense annotations and consistently fail to estimate accurate semantic labels for unseen categories. This obstruction spurs a craze for studying visual semantic segmentation with the assistance of few/zero-shot learning. The emergence and rapid progress of few/zero-shot visual semantic segmentation make it possible to learn unseen categories from a few labeled or even zero-labeled samples, which advances the extension to practical applications. Therefore, this paper focuses on the recently published few/zero-shot visual semantic segmentation methods varying from 2D to 3D space and explores the commonalities and discrepancies of technical settlements under different segmentation circumstances. Specifically, the preliminaries on few/zero-shot visual semantic segmentation, including the problem definitions, typical datasets, and technical remedies, are briefly reviewed and discussed. Moreover, three typical instantiations are involved to uncover the interactions of few/zero-shot learning with visual semantic segmentation, including image semantic segmentation, video object segmentation, and 3D segmentation. Finally, the future challenges of few/zero-shot visual semantic segmentation are discussed.
Keywords:
Visualization
Three-dimensional displays
Semantic segmentation
Task analysis
Semantics
Annotations
Training
Computer vision
deep learning
few-shot learning
low-shot learning
semantic segmentation
zero-shot learning

Journal

I
IEEE-CAA Journal of Automatica Sinica
IF:
19.2
Papers:
1.4K
Citations:
1.1W

Organization

A
aviation industry corporation of china (avic)
Scholars:
1.7K
Papers: 1.4K
Citations: 2
S
Swinburne University of Technology
Scholars:
9.3K
Papers: 1.2W
Citations: 2.0W