arrow
Return

Patient representation learning and interpretable evaluation using clinical notes

delete2018-08-01
delete30
delete
OA
AI
M
Madhumita Sushil *
S
Simon Šuster
K
Kim Luyckx
W
Walter Daelemans
DOI:10.1016/j.jbi.2018.06.016delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
We have three contributions in this work: 1. We explore the utility of a stacked denoising autoencoder and a paragraph vector model to learn task-independent dense patient representations directly from clinical notes. To analyze if these representations are transferable across tasks, we evaluate them in multiple supervised setups to predict patient mortality, primary diagnostic and procedural category, and gender. We compare their performance with sparse representations obtained from a bag-of-words model. We observe that the learned generalized representations significantly outperform the sparse representations when we have few positive instances to learn from, and there is an absence of strong lexical features. 2. We compare the model performance of the feature set constructed from a bag of words to that obtained from medical concepts. In the latter case, concepts represent problems, treatments, and tests. We find that concept identification does not improve the classification performance. 3. We propose novel techniques to facilitate model interpretability. To understand and interpret the representations, we explore the best encoded features within the patient representations obtained from the autoencoder model. Further, we calculate feature sensitivity across two networks to identify the most significant input features for different classification tasks when we use these pretrained representations as the supervised input. We successfully extract the most influential features for the pipeline using this technique.
Keywords:
Representation learning
Patient representations
Model interpretability
Natural language processing
Unsupervised learning

Journal

Journal of Biomedical Informatics cover
Journal of Biomedical Informatics
IF:
4.5
Papers:
3.6K
Citations:
1.9W

Organization

U
University of Antwerp
Scholars:
2.1W
Papers: 1.9W
Citations: 2.6W
Cited Papers

Cited Papers

errShare
errSave
Biosensor based on Langmuir–Blodgett films of poly(3-hexyl thiophene) for detection of galactose in human blood
err2004-04-01
err0
PREAI
errSandeep K. Sharma; Rahul Singhal; B.D. Malhotra; Neeta Sehgal; Ashok Kumar
errShare
errSave
Nucleotide Sequence Analysis of a Candidate Gene for Ataxia-Telangiectasia Group D (ATDC)
err1994-01-01
err0
PREAI
errEdith A. Leonhardt; Leon N. Kapp; Barbara R. Young; John P. Murnane
errShare
errSave
errShare
errSave
Self-assembled spongy-like MnO2 electrode materials for supercapacitors
err2012-08-01
err0
PREAI
errMeng Dong; Yu Xin Zhang; Hong Fang Song; Xin Qiu; Xiao Dong Hao; Chuan Pu Liu; Yuan Yuan; Xin Lu Li; Jia Mu Huang
errShare
errSave
Identification of type 2 diabetes subgroups through topological analysis of patient similarity
err2015-10-28
err389
errOAAI
errLi, Li; Cheng, Wei-Yi; Glicksberg, Benjamin S.; Gottesman, Omri; Tamler, Ronald; Chen, Rong; Bottinger, Erwin P.; Dudley, Joel T.
errShare
errSave
A method for inferring medical diagnoses from patient similarities
err2013-09-02
err61
errOAAI
errGottlieb, Assaf; Stein, Gideon Y.; Ruppin, Eytan; Altman, Russ B.; Sharan, Roded
errShare
errSave
Pain vulnerability: a neurobiological perspective
err2014-01-28
err0
errOAAI
errFranziska Denk; Stephen B McMahon; Irene Tracey
errShare
errSave
researcher View more