返回
Language Semantics Interpretation with an Interaction-Based Recurrent Neural Network
DOI:10.3390/make3040046.png)
摘要
En 中文
Text classification is a fundamental language task in Natural Language Processing. A variety of sequential models are capable of making good predictions, yet there is a lack of connection between language semantics and prediction results. This paper proposes a novel influence score (I-score), a greedy search algorithm, called Backward Dropping Algorithm (BDA), and a novel feature engineering technique called the dagger technique. First, the paper proposes to use the novel influence score (I-score) to detect and search for the important language semantics in text documents that are useful for making good predictions in text classification tasks. Next, a greedy search algorithm, called the Backward Dropping Algorithm, is proposed to handle long-term dependencies in the dataset. Moreover, the paper proposes a novel engineering technique called the dagger technique that fully preserves the relationship between the explanatory variable and the response variable. The proposed techniques can be further generalized into any feed-forward Artificial Neural Networks (ANNs) and Convolutional Neural Networks (CNNs), and any neural network. A real-world application on the Internet Movie Database (IMDB) is used and the proposed methods are applied to improve prediction performance with an 81% error reduction compared to other popular peers if I-score and dagger technique are not implemented.
Keyword:
neural networks
interaction-based learning
I-score
dagger technique
期刊
M
IF:
6
论文数:
865
被引数:
1.8K
机构
引用论文
Potential-Dependent Reorientation of Water Molecules at an Electrode/Electrolyte Interface Studied by Surface-Enhanced Infrared Absorption Spectroscopy通过表面增强红外吸收光谱法研究的电极/电解质界面上水分子的电位依赖性重新取向
Cobalt and Copper Composite Oxides as Efficient Catalysts for Preferential Oxidation of CO in H2-Rich Stream钴和铜复合氧化物作为H2-Rich流中CO优先氧化的有效催化剂

