.png){kind=icon}
返回
Deep Multi-Modal Network Based Automated Depression Severity Estimation
.png){kind=icon}
PRE
AI
DOI：10.1109/TAFFC.2022.3179478.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Depression is a severe mental illness that impairs a person's capacity to function normally in personal and professional life. The assessment of depression usually requires a comprehensive examination by an expert professional. Recently, machine learning-based automatic depression assessment has received considerable attention for a reliable and efficient depression diagnosis. Various techniques for automated depression detection were developed; however, certain concerns still need to be investigated. In this work, we propose a novel deep multi-modal framework that effectively utilizes facial and verbal cues for an automated depression assessment. Specifically, we first partition the audio and video data into fixed-length segments. Then, these segments are fed into the Spatio-Temporal Networks as input, which captures both spatial and temporal features as well as assigns higher weights to the features that contribute most. In addition, Volume Local Directional Structural Pattern (VLDSP) based dynamic feature descriptor is introduced to extract the facial dynamics by encoding the structural aspects. Afterwards, we employ the Temporal Attentive Pooling (TAP) approach to summarize the segment-level features for audio and video data. Finally, the multi-modal factorized bilinear pooling (MFB) strategy is applied to fuse the multi-modal features effectively. An extensive experimental study reveals that the proposed method outperforms state-of-the-art approaches.
Keyword:
Depression
Feature extraction
Three-dimensional displays
Convolutional neural networks
Optical flow
Long short term memory
Encoding
spatio-temporal networks
volume local directional structural pattern
temporal attentive pooling
multi-modal factorized bilinear pooling
期刊
IF:
9.8
论文数:
1.4K
被引数:
9.1K
机构
引用论文
Regio- and chemoselective epoxidation of fluorinated monoterpenes and sesquiterpenes by dioxiranes.png)
Tetrahedron
TetrahedronIF0
PREAI
分享收藏
A Framework for Modeling, Simulation and Automatic Code Generation of Sensor Network Application
PREAI
分享收藏分享收藏分享收藏
查看更多内容