Multitask deep learning for native language identification

doi:10.1016/j.knosys.2020.106440

Multitask deep learning for native language identification

2020-12-01

12

OA

AI

DOI：10.1016/j.knosys.2020.106440

Original

Save

View PDF

Abstract

En 中文

Identifying the native language of a person by their text written in English (L1 identification) plays an important role in such tasks as authorship profiling and identification. With the current proliferation of misinformation in social media, these methods are especially topical. Most studies in this field have focused on the development of supervised classification algorithms, that are trained on a single L1 dataset. Although multiple labeled datasets are available for L1 identification, they contain texts authored by speakers of different languages and do not completely overlap. Current approaches achieve high accuracy on available datasets, but this is attained by training an individual classifier for each dataset. Studies show that joint training of multiple classifiers on different datasets can result in sharing information between the classifiers, leading to an increase in the accuracy of both tasks. In this study, we develop a novel deep neural network (DNN) architecture for L1 classification; it is based on an adversarial multitask learning method that integrates shared knowledge from multiple L1 datasets. We propose several variants of the architecture and rigorously evaluate their performance on multiple datasets. Our results indicate the proposed multitask architecture is more efficient in terms of classification accuracy than previously proposed methods. (C) 2020 Published by Elsevier B.V.

Keywords:

Multitask learning

Text classification

Natural language processing

Deep learning

Multitask deep learning for native language identification

Abstract

AI Summary

Journal

Organization