arrow
Return

Cross-modality collaborative learning identified pedestrian

delete2022-09-26
delete4
PRE
AI
X
Xiongjun Wen
X
Xin Feng *
李平 cover
李平 (Ping Li)
W
Wenfang Chen
DOI:10.1007/s00371-022-02579-ydelete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Cross-modal pedestrian re-identification is a key technology to realize all-weather intelligent video surveillance system. This technology is designed to match the visible light image and infrared image of a pedestrian with a specific identity in a non-overlapping camera scene, so it faces huge intra-class changes and modal differences. Existing methods are difficult to solve these two difficulties, which is largely due to the lack of effective mining of feature discrimination and the full use of multi-source heterogeneous information. In view of the above shortcomings, a refined multi-source feature collaborative network is designed by the collaborative learning method, and multiple complementary features are extracted for information fusion, the learning ability of the network is improved. Multi-scale and multi-level features are extracted from the backbone convolutional network, and the refined feature collaborative learning is realized; the discriminative ability of features is enhanced to deal with intra-class changes. A modal sharing and unique feature collaboration module and a cross-modal human semantic self-supervision module are designed to achieve the purpose of multi-source feature collaborative learning, so as to improve the utilization of multi-source heterogeneous image information, and then modal differences are resolved. The validity and advancement of this method are verified on the SYSU-MM01 and RegDB data sets.
Keywords:
Pedestrian re-identification
Cross modality
Collaborative learning
Refined features
Multi-source features
Information fusion

Journal

Visual Computer cover
Visual Computer
IF:
2.9
Papers:
4.6K
Citations:
6.5K

Organization

No organization information available
Cited Papers

Cited Papers

Temperature dependence of excitability indices of human cutaneous afferents
err1999-01-01
err0
PREAI
errDavid Burke; Ilona Mogyoros; Rebecca Vagg; Matthew C. Kiernan
errShare
errSave
Cutaneous reflexes in Parkinson's disease
err2004-10-13
err0
PREAI
errPeter Fuhr; Thomas Zeffiro; Mark Hallett
errShare
errSave
Elbow Injuries To The Throwing Athlete
err1996-04-01
err0
PREAI
errJack Johnston; Kevin D. Plancher; Richard J. Hawkins
errShare
errSave
The Impact of Participant Mobility on Missed Visits among Women Taking Part in the VOICE (MTN-003) Study in Zimbabwe
err2014-10-01
err0
PREAI
errPepukai Ndadziyira; Shingirayi I. Samupindi; Christine Vuta; Angeline Matanhire; Emilder Chihota; Patricia M. Dhlakama; Petina Musara; Margaret Mlingo; Nyaradzo M. Mgodi; Zvavahera Mike Chirenje
errShare
errSave
Enhanced declarative memory in long-term mindfulness practitioners
err2022-02-28
err0
PREAI
errLimor Shemesh; Avi Mendelsohn; Daniel Yochai Panitz; Aviva Berkovich-Ohana
errShare
errSave
errShare
errSave
A gD Homologous Gene of Feline Herpesvirus Type I Encodes a Hemagglutinin (gp60)
err1994-08-01
err0
PREAI
errKen Maeda; Yasushi Kawaguchi; Mitsuru Ono; Yasuo Inoshima; Takayuki Miyazawa; Yukinobu Tohya; Chieko Kai; Takeshi Mikami
errShare
errSave
researcher View more