arrow
返回

Lightweight Conceptual Dictionary Learning for Text Classification Using Information Compression

delete2024-12-01
delete0
delete
OA
AI
L
Li Wan *
T
Tansu Alpcan
M
Margreta Kuijper
E
Emanuele Viterbo
DOI:10.1109/TKDE.2024.3421255delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
We propose a novel supervised dictionary learning framework for text classification, integrating the Lempel-Ziv-Welch (LZW) algorithm for data compression and dictionary construction. This two-phase approach refines dictionaries by optimizing dictionary atoms for discriminative power using mutual information and class distribution. Our method facilitates classifier training, such as SVMs and neural networks. We introduce the information plane area rank (IPAR) to evaluate the information-theoretic performance of our algorithm. Tested on six benchmark text datasets, our model performs nearly as well as top models in limited-vocabulary settings, lagging by only about 2% while using just 10% of the parameters. However, its performance drops in diverse-vocabulary contexts due to the LZW algorithm's limitations with low-repetition data. This contrast highlights its efficiency and limitations across different dataset types.
Keyword:
Dictionaries
Atoms
Classification algorithms
Text categorization
Neural networks
Accuracy
Vectors
Dictionary learning
information bottleneck
information theory
supervised learning

期刊

IEEE Transactions on Knowledge and Data Engineering 封面图
IEEE Transactions on Knowledge and Data Engineering
IF:
10.4
论文数:
6.9K
被引数:
3.2W

机构

M
Monash University
学者数:
5.4W
论文数: 5.4W
被引数: 79
U
university of melbourne
学者数:
5.7W
论文数: 5.4W
被引数: 69
引用论文

引用论文

Bioengineering solutions for expansive soil stabilization using waste materials: An experimental evaluation
err2024-05-06
err0
errOAAI
errKaranbir Singh Randhawa; Raman Kumar; Hamad Alkaabi; Meshel Q. Alkahtani; Saiful Islam; Chander Prakash; Rahul Kumar; Muhammad Imam Ammarullah
err分享
err收藏
Deep Dictionary Learning: A PARametric NETwork Approach
err2019-10-01
err46
errOAAI
errMahdizadehaghdam, Shahin; Panahi, Ashkan; Krim, Hamid; Dai, Liyi
err分享
err收藏
Modeling and validation of a piezoelectric actuator
err2006-11-29
err0
PREAI
errOriol Gomis-Bellmunt; Fayçal Ikhouane; Pere Castell-Vilanova; Joan Bergas-Jané
err分享
err收藏
err
IF0
err
err0
PREAI
err
err分享
err收藏
Efficient Prediction of Structural and Electronic Properties of Hybrid 2D Materials Using Complementary DFT and Machine Learning Approaches
err2018-10-31
err0
errOAAI
errSherif Abdulkader Tawfik; Olexandr Isayev; Catherine Stampfl; Joe Shapter; David A. Winkler; Michael J. Ford
err分享
err收藏
Deep Dictionary Learning深度字典学习
err2016-01-01
err122
errOAAI
errTariyal, Snigdha; Majumdar, Angshul; Singh, Richa; Vatsa, Mayank
err分享
err收藏
学者 查看更多内容