.png){kind=icon}
返回
Automatic depression severity assessment with deep learning using parameter-efficient tuning
.png){kind=icon}
OA
AI
DOI：10.3389/fpsyt.2023.1160291.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
IntroductionTo assist mental health care providers with the assessment of depression, research to develop a standardized, accessible, and non-invasive technique has garnered considerable attention. Our study focuses on the application of deep learning models for automatic assessment of depression severity based on clinical interview transcriptions. Despite the recent success of deep learning, the lack of large-scale high-quality datasets is a major performance bottleneck for many mental health applications. MethodsA novel approach is proposed to address the data scarcity problem for depression assessment. It leverages both pretrained large language models and parameter-efficient tuning techniques. The approach is built upon adapting a small set of tunable parameters, known as prefix vectors, to guide a pretrained model towards predicting the Patient Health Questionnaire (PHQ)-8 score of a person. Experiments were conducted on the Distress Analysis Interview Corpus - Wizard of Oz (DAIC-WOZ) benchmark dataset with 189 subjects, partitioned into training, development, and test sets. Model learning was done on the training set. Prediction performance mean and standard deviation of each model, with five randomly-initialized runs, were reported on the development set. Finally, optimized models were evaluated on the test set. ResultsThe proposed model with prefix vectors outperformed all previously published methods, including models which utilized multiple types of data modalities, and achieved the best reported performance on the test set of DAIC-WOZ with a root mean square error of 4.67 and a mean absolute error of 3.80 on the PHQ-8 scale. Compared to conventionally fine-tuned baseline models, prefix-enhanced models were less prone to overfitting by using far fewer training parameters (<6% relatively). DiscussionWhile transfer learning through pretrained large language models can provide a good starting point for downstream learning, prefix vectors can further adapt the pretrained models effectively to the depression assessment task by only adjusting a small number of parameters. The improvement is in part due to the fine-grain flexibility of prefix vector size in adjusting the model's learning capacity. Our results provide evidence that prefix-tuning can be a useful approach in developing tools for automatic depression assessment.
Keyword:
depression assessment
prefix-tuning
transfer learning
deep learning
clinical decision support
natural language processing (NLP)
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
3.2
论文数:
1.8W
被引数:
4.8W
机构
引用论文
Bound plasminogen is rate-limiting for cell-surface-mediated activation of plasminogen by urokinaseOAAI
OAAI分享收藏Matrix Effects in the Detection of Pb and Ba in Soils Using Laser-Induced Breakdown Spectroscopy使用激光诱导击穿光谱检测土壤中Pb和Ba的基质效应
PREAI
分享收藏Regio- and chemoselective epoxidation of fluorinated monoterpenes and sesquiterpenes by dioxiranes.png)
Tetrahedron
TetrahedronIF0
PREAI
分享收藏Global, regional, and national incidence, prevalence, and years lived with disability for 354 diseases and injuries for 195 countries and territories, 1990-2017: a systematic analysis for the Global Burden of Disease Study 20171990至2017 195个国家和地区的354疾病和伤害的全球，区域和国家发病率，患病率和残疾年限: 全球疾病负担研究2017的系统分析LANCETOAAI
LANCETIF88.5
OAAI分享收藏分享收藏Global prevalence and burden of depressive and anxiety disorders in 204 countries and territories in 2020 due to the COVID-19 pandemic新型冠状病毒肺炎大流行2020年204个国家和地区的全球抑郁症和焦虑疾病患病率和负担LANCETOAAI
LANCETIF88.5
OAAI分享收藏
查看更多内容