arrow
Return

A Survey on Parallel Reasoning

delete2026-09-24
delete0
delete
OA
AI
汪
汪子琪 (Ziqi Wang) *
B
Boye Niu *
Z
Zipeng Gao *
Z
Zhi Zheng
徐
徐童 (Tong Xu)
L
Linghui Meng
Z
Zhongli Li
L
Liu Jing
Y
Yilong Chen
C
Chen Zhu
H
Hua Wu
H
Haifeng Wang *
陈
陈恩红 (Enhong Chen) *
DOI:10.1093/nsr/nwag599delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
As Large Language Models (LLMs) evolve, parallel reasoning has emerged as a vital inference paradigm that enhances robustness by concurrently exploring multiple thought trajectories. Unlike fragile sequential methods, parallel reasoning expands inference breadth to significantly improve problem-solving performance. This paper provides a comprehensive survey of the progress and challenges in this burgeoning field. We first formally define parallel reasoning and distinguish it from sequential paradigms like Chain-of-Thought. Then, we propose a novel taxonomy to categorize advanced techniques into non-interactive reasoning, interactive collaboration, and efficiency-oriented decoding strategies. Furthermore, we examine diverse application scenarios, including complex problem-solving and reliability enhancement. Finally, we identify core challenges and outline future research directions. This work serves as a strategic roadmap to foster further innovation in parallel reasoning.

Journal

National Science Review cover
National Science Review
IF:
17.1
Papers:
3.8K
Citations:
2.0W

Organization

U
University of Science and Technology of China
Scholars:
2.6K
Papers: 842
Citations: 0
B
baidu inc
Scholars:
13
Papers: 5
Citations: 0
Cited Papers

Cited Papers

No cited papers available