.png){kind=icon}
.png){kind=icon}
Return
Quantum mixed-state self-attention network
.png){kind=icon}
OA
AI
DOI：10.1016/j.neunet.2025.107123.png)
.png){kind=icon}
.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
Attention mechanisms have revolutionized natural language processing. Combining them with quantum computing aims to further advance this technology. This paper introduces a novel Quantum Mixed-State Self- Attention Network (QMSAN) for natural language processing tasks. Our model leverages quantum computing principles to enhance the effectiveness of self-attention mechanisms. QMSAN uses a quantum attention mechanism based on mixed state, allowing for direct similarity estimation between queries and keys in the quantum domain. This approach leads to more effective attention coefficient calculations. We also propose an innovative quantum positional encoding scheme, implemented through fixed quantum gates within the circuit, improving the model's ability to capture sequence information without additional qubit resources. In numerical experiments of text classification tasks on public datasets, QMSAN outperforms Quantum Self- Attention Neural Network (QSANN). Furthermore, we demonstrate QMSAN's robustness indifferent quantum noise environments, highlighting its potential for near-term quantum devices.
Keywords:
Quantum machine learning
Self-attention mechanism
Quantum self-attention mechanism
Text classification
AI Summary
Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.
Journal
IF:
6.3
Papers:
7.8K
Citations:
3.0W