arrow
Return

Compositional coding capsule network with k-means routing for text classification

delete2022-08-01
delete21
delete
OA
AI
H
Hao Ren
H
Hong Lu *
DOI:10.1016/j.patrec.2022.05.028delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Text classification is a challenging problem which aims to identify the category of texts. In the process of training, word embeddings occupy a large part of parameters. Under the constraint of limited computing resources, it indirectly restricts the ability of subsequent network design. In order to reduce the number of parameters for constructing word embeddings, this paper explores compositional coding mechanism and proposes a compositional weighted coding method to replace the conventional embedding layer. Furthermore, inspired by the excellent performance of capsule network in image classification, we design a capsule network combined with our compositional weighted coding method for text classification. We also offer a new routing algorithm based on k-means clustering theory to thoroughly mine the relationship between capsules. Experiments conducted on eight challenging text classification datasets show that the proposed method achieves competitive accuracy compared to the state-of-the-art approach with significantly fewer parameters. (C) 2022 Elsevier B.V. All rights reserved.
Keywords:
Text classification
Capsule network
Compositional code
Deep learning
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Pattern Recognition Letters cover
Pattern Recognition Letters
IF:
3.3
Papers:
7.9K
Citations:
1.6W

Organization

F
fudan university
Scholars:
11.7W
Papers: 7.7W
Citations: 121