arrow
Return

Location Sensitive Network for Human Instance Segmentation

delete2021-01-01
delete5
PRE
AI
X
Xiangzhou Zhang
马
马丙鹏 (Bingpeng Ma) *
常虹 cover
常虹 (Hong Chang)
山世光 cover
山世光 (Shiguang Shan)
陈
陈熙霖 (Xilin Chen)
DOI:10.1109/TIP.2021.3107210delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Location is an important distinguishing information for instance segmentation. In this paper, we propose a novel model, called Location Sensitive Network (LSNet), for human instance segmentation. LSNet integrates instance-specific location information into one-stage segmentation framework. Specifically, in the segmentation branch, Pose Attention Module (PAM) encodes the location information into the attention regions through coordinates encoding. Based on the location information provided by PAM, the segmentation branch is able to effectively distinguish instances in feature-level. Moreover, we propose a combination operation named Keypoints Sensitive Combination (KSCom) to utilize the location information from multiple sampling points. These sampling points construct the points representation for instances via human keypoints and random points. Human keypoints provide the spatial locations and semantic information of the instances, and random points expand the receptive fields. Based on the points representation for each instance, KSCom effectively reduces the mis-classified pixels. Our method is validated by the experiments on public datasets. LSNet-5 achieves 56.2 mAP at 18.5 FPS on COCOPersons. Besides, the proposed method is significantly superior to its peers in the case of severe occlusion.
Keywords:
Image segmentation
Prototypes
Heating systems
Task analysis
Semantics
Feature extraction
Detectors
Human instance segmentation
spatial invariance
coordinates encoding
points representation
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Transactions on Image Processing cover
IEEE Transactions on Image Processing
IF:
13.7
Papers:
1.0W
Citations:
8.4W

Organization

U
university of chinese academy of sciences, cas
Scholars:
4.1W
Papers: 3.8W
Citations: 75
S
ShanghaiTech University
Scholars:
9.7K
Papers: 5.9K
Citations: 1.6W
C
chinese academy of sciences
Scholars:
56.7W
Papers: 45.0W
Citations: 704
researcher View more organizations
Cited Papers

Cited Papers

errShare
errSave
Edge-Sensitive Human Cutout With Hierarchical Granularity and Loopy Matting Guidance
err2020-01-01
err11
PREAI
errYe, Jingwen; Jing, Yongcheng; Wang, Xinchao; Ou, Kairi; Tao, Dacheng; Song, Mingli
errShare
errSave
A Monte Carlo model of irradiation-induced recrystallization in polycrystalline UMo fuels
err2019-10-01
err0
errOAAI
errWilliam E. Frazier; Shenyang Hu; Douglas E. Burkes; Benjamin W. Beeler
errShare
errSave
Promoting Inclusive Growth
err
IF0
err2012-04-06
err0
errOAAI
err
errShare
errSave
researcher View more