arrow
返回

Language Semantics Interpretation with an Interaction-Based Recurrent Neural Network

delete2021-11-19
delete2
delete
OA
AI
S
Shaw‐Hwa Lo *
Y
Yiqiao Yin
DOI:10.3390/make3040046delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Text classification is a fundamental language task in Natural Language Processing. A variety of sequential models are capable of making good predictions, yet there is a lack of connection between language semantics and prediction results. This paper proposes a novel influence score (I-score), a greedy search algorithm, called Backward Dropping Algorithm (BDA), and a novel feature engineering technique called the dagger technique. First, the paper proposes to use the novel influence score (I-score) to detect and search for the important language semantics in text documents that are useful for making good predictions in text classification tasks. Next, a greedy search algorithm, called the Backward Dropping Algorithm, is proposed to handle long-term dependencies in the dataset. Moreover, the paper proposes a novel engineering technique called the dagger technique that fully preserves the relationship between the explanatory variable and the response variable. The proposed techniques can be further generalized into any feed-forward Artificial Neural Networks (ANNs) and Convolutional Neural Networks (CNNs), and any neural network. A real-world application on the Internet Movie Database (IMDB) is used and the proposed methods are applied to improve prediction performance with an 81% error reduction compared to other popular peers if I-score and dagger technique are not implemented.
Keyword:
neural networks
interaction-based learning
I-score
dagger technique

期刊

M
Machine Learning and Knowledge Extraction
IF:
6
论文数:
865
被引数:
1.8K

机构

C
Columbia University
学者数:
7.1W
论文数: 6.4W
被引数: 263
引用论文

引用论文

A new concordant partial AUC and partial c statistic for imbalanced data in the evaluation of machine learning algorithms
err2020-01-06
err111
errOAAI
errCarrington, Andre M.; Fieguth, Paul W.; Qazi, Hammad; Holzinger, Andreas; Chen, Helen H.; Mayr, Franz; Manuel, Douglas G.
err分享
err收藏
From a Science Fiction to the Reality
err2017-01-01
err0
errOAAI
errMurata Kiyoshi; A. Adams Andrew; Fukuta Yasunori; Orito Yohko; Arias-Oliva Mario; Pelegrin-Borondo Jorge
err分享
err收藏
A survey on modern trainable activation functions
err2021-06-01
err282
errOAAI
errApicella, Andrea; Donnarumma, Francesco; Isgro, Francesco; Prevete, Roberto
err分享
err收藏
Cryptanalysis of Round-Reduced Fantomas, Robin and iSCREAM
err2019-01-10
err0
errOAAI
errAshutosh Dhar Dwivedi; Shalini Dhar; Gautam Srivastava; Rajani Singh
err分享
err收藏
学者 查看更多内容