arrow
Return

Robust Unsupervised Discriminative Dependency Parsing

delete2020-04-01
delete2
delete
OA
AI
Y
Yong Jiang *
J
Jiong Cai
K
Kewei Tu
DOI:10.26599/TST.2018.9010145delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Discriminative approaches have shown their effectiveness in unsupervised dependency parsing. However, due to their strong representational power, discriminative approaches tend to quickly converge to poor local optima during unsupervised training. In this paper, we tackle this problem by drawing inspiration from robust deep learning techniques. Specifically, we propose robust unsupervised discriminative dependency parsing, a framework that integrates the concepts of denoising autoencoders and conditional random field autoencoders. Within this framework, we propose two types of sentence corruption mechanisms as well as a posterior regularization method for robust training. We tested our methods on eight languages and the results show that our methods lead to significant improvements over previous work.
Keywords:
unsupervised learning
dependency parsing
autoencoders
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

T
Tsinghua Science and Technology
IF:
3.5
Papers:
987
Citations:
2.5K

Organization

S
ShanghaiTech University
Scholars:
9.6K
Papers: 5.9K
Citations: 1.6W