.png){kind=icon}
返回
Learning Word and Sentence Embeddings Using a Generative Convolutional Network
.png){kind=icon}
PRE
AI
DOI：10.1007/978-3-319-92198-3_14.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
In recent years, sentence modeling using dense vector representations has been a central concern in Natural Language Processing research. While many efforts are essentially focused on the quality of the embeddings in downstream classification tasks, our contribution focuses on the understanding of new forms of computing word representations using generative architectures based on 2D Convolutional Neural Networks. We treat a sentence as a n x m input image, such that it can be processed using 2D convolutional operations. In contrast to similar current approaches, where the input image remains untouched along the whole learning process, our contribution proposes the use of the learned 2D convolutional filters for modifying the input arrays in order to compute the corresponding word and sentence vector representations at once. We also propose to compute word dictionaries for local contexts and a global dictionary to fuse every word local meaning in a single representation. We call this proposed model a Word Embedding Generative Convolutional Network (WEGCN). Our experiments show that our method is capable of jointly estimating consistent word and sentence embeddings, thus opening pathways for future research in this vein.
Keyword:
Generative models
Convolutional neural networks
Word embeddings
Rhetorical status classification
期刊
IF:
7.6
论文数:
1.3W
被引数:
4.5W
机构
引用论文
ARVino - outdoor augmented reality visualisation of viticulture GIS dataARVino-葡萄栽培GIS数据的户外增强现实可视化
OAAI
OAAI分享收藏Enhancement of pyramid solar distiller performance using reflectors, cooling cycle, and dangled cords of wicks.png)
Desalination
DesalinationIF0
PREAI
分享收藏Gradient-based learning applied to document recognition基于梯度的学习在文档识别中的应用PROCEEDINGS OF THE IEEE
PROCEEDINGS OF THE IEEEIF25.9
PREAI
分享收藏Inosine pranobex enhances human NK cell cytotoxicity by inducing metabolic activation and NKG2D ligand expression肌苷pranobex通过诱导代谢活化和NKG2D配体表达增强人NK细胞的细胞毒性OAAI
OAAI分享收藏
没有更多内容
没有更多内容