.png){kind=icon}
返回
Multi-Level Transformer-Based Social Relation Recognition
.png){kind=icon}
OA
AI
DOI：10.3390/s22155749.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Social relationships refer to the connections that exist between people and indicate how people interact in society. The effective recognition of social relationships is conducive to further understanding human behavioral patterns and thus can be vital for more complex social intelligent systems, such as interactive robots and health self-management systems. The existing works about social relation recognition (SRR) focus on extracting features on different scales but lack a comprehensive mechanism to orchestrate various features which show different degrees of importance. In this paper, we propose a new SRR framework, namely Multi-level Transformer-Based Social Relation Recognition (MT-SRR), for better orchestrating features on different scales. Specifically, a vision transformer (ViT) is firstly employed as a feature extraction module for its advantage in exploiting global features. An intra-relation transformer (Intra-TRM) is then introduced to dynamically fuse the extracted features to generate more rational social relation representations. Next, an inter-relation transformer (Inter-TRM) is adopted to further enhance the social relation representations by attentionally utilizing the logical constraints among relationships. In addition, a new margin related to inter-class similarity and a sample number are added to alleviate the challenges of a data imbalance. Extensive experiments demonstrate that MT-SRR can better fuse features on different scales as well as ameliorate the bad effect caused by a data imbalance. The results on the benchmark datasets show that our proposed model outperforms the state-of-the-art methods with significant improvement.
Keyword:
social relation recognition
data driven
social intelligence
transformer
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
3.5
论文数:
7.2W
被引数:
20.9W
机构
引用论文
Estimation of surface roughness for turning operations using image texture features.png)
Proceedings of the Institution of Mechanical Engineers, Part B: Journal of Engineering Manufacture
Proceedings of the Institution of Mechanical Engineers, Part B: Journal of Engineering ManufactureIF0
PREAI
分享收藏Inflexibility of mental planning: A characteristic disorder with prefrontal lobe lesions?心理计划的僵化: 前额叶病变的特征性障碍？
PREAI
分享收藏分享收藏Street Design for Hedonistic Sustainability through AI and Human Co-Operative EvaluationSUSTAINABILITY
OAAI
SUSTAINABILITYIF3.3
OAAI分享收藏Modelling and Experimental Assessment of Inter-Personal Distancing Based on Shared GNSS ObservablesSENSORSOAAI
SENSORSIF3.5
OAAI分享收藏
查看更多内容