.png){kind=icon}
返回
Self-supervised pre-trained neural network for quantum natural language processing
.png){kind=icon}
PRE
AI
DOI：10.1016/j.neunet.2024.107004.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Quantum computing models have propelled advances in many application domains. However, in the field of natural language processing (NLP), quantum computing models are limited in representation capacity due to the high linearity of the underlying quantum computing architecture. This work attempts to address this limitation by leveraging the concept of self-supervised pre-training, a paradigm that has been propelling the rocketing development of NLP, to increase the power of quantum NLP models on the representation level. Specifically, we present a self-supervised pre-training approach to train quantum encodings of sentences, and fine-tune quantum circuits for downstream tasks on its basis. Experiments show that pre-trained mechanism brings remarkable improvement over end-to-end pure quantum models, yielding meaningful prediction results on a variety of downstream text classification datasets.
Keyword:
Quantum computing
Natural language processing
Self-supervised pre-training
期刊
IF:
6.3
论文数:
7.8K
被引数:
3.0W
机构
引用论文
.png){kind=icon}
分享收藏
查看更多内容