arrow
返回

Hierarchical Deep Document Model

delete2025-01-01
delete0
PRE
AI
杨
杨懿 (Yi Yang)
J
John P. Lalor
A
Ahmed Abbasi *
D
Daniel Zeng
DOI:10.1109/TKDE.2024.3487523delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Topic modeling is a commonly used text analysis tool for discovering latent topics in a text corpus. However, while topics in a text corpus often exhibit a hierarchical structure (e.g., cellphone is a sub-topic of electronics), most topic modeling methods assume a flat topic structure that ignores the hierarchical dependency among topics, or utilize a predefined topic hierarchy. In this work, we present a novel Hierarchical Deep Document Model (HDDM) to learn topic hierarchies using a variational autoencoder framework. We propose a novel objective function, sum of log likelihood, instead of the widely used evidence lower bound, to facilitate the learning of hierarchical latent topic structure. The proposed objective function can directly model and optimize the hierarchical topic-word distributions at all topic levels. We conduct experiments on four real-world text datasets to evaluate the topic modeling capability of the proposed HDDM method compared to state-of-the-art hierarchical topic modeling benchmarks. Experimental results show that HDDM achieves considerable improvement over benchmarks and is capable of learning meaningful topics and topic hierarchies. To further demonstrate the practical utility of HDDM, we apply it to a real-world medical notes dataset for clinical prediction. Experimental results show that HDDM can better summarize topics in medical notes, resulting in more accurate clinical predictions.
Keyword:
Analytical models
Predictive models
Data models
Stacking
Context modeling
Linear programming
Accuracy
Reviews
Neural networks
Benchmark testing
Deep learning
hierarchical modeling
hierarchical neural topic model
textual analysis
topic modeling

期刊

IEEE Transactions on Knowledge and Data Engineering 封面图
IEEE Transactions on Knowledge and Data Engineering
IF:
10.4
论文数:
6.9K
被引数:
3.2W

机构

U
University of Notre Dame
学者数:
1.2W
论文数: 1.1W
被引数: 1.7W
C
chinese academy of sciences
学者数:
56.7W
论文数: 45.0W
被引数: 704
引用论文

引用论文

err分享
err收藏
Deep Learning for Adverse Event Detection From Web Search
err2020-01-01
err16
errOAAI
errAhmad, Faizan; Abbasi, Ahmed; Kitchens, Brent; Adjeroh, Donald; Zeng, Daniel
err分享
err收藏
Synthetic Aperture Radar Target Recognition with Feature Fusion Based on a Stacked Autoencoder
errSENSORS
IF3.5
err2017-01-20
err99
errOAAI
errKang, Miao; Ji, Kefeng; Leng, Xiangguang; Xing, Xiangwei; Zou, Huanxin
err分享
err收藏
Long-Acting Injectable Risperidone
err2004-12-01
err0
PREAI
errMegan J Ehret; Matthew A Fuller
err分享
err收藏
Scalable and accurate deep learning with electronic health records通过电子健康记录进行可扩展且准确的深度学习
err2018-05-08
err1.4K
errOAAI
errRajkomar, Alvin; Oren, Eyal; Chen, Kai; Dai, Andrew M.; Hajaj, Nissan; Hardt, Michaela; Liu, Peter J.; Liu, Xiaobing; Marcus, Jake; Sun, Mimi; Sundberg, Patrik; Yee, Hector; Zhang, Kun; Zhang, Yi; Flores, Gerardo; Duggan, Gavin E.; Irvine, Jamie; Quoc Le; Litsch, Kurt; Mossin, Alexander; Tansuwan, Justin; Wang, De; Wexler, James; Wilson, Jimbo; Ludwig, Dana; Volchenboum, Samuel L.; Chou, Katherine; Pearson, Michael; Madabushi, Srinivasan; Shah, Nigam H.; Butte, Atul J.; Howell, Michael D.; Cui, Claire; Corrado, Greg S.; Dean, Jeffrey
err分享
err收藏
学者 查看更多内容