arrow
Return

CRMR: A Collaborative Multistep Reasoning Framework for Solving Mathematical Problems

delete2025-04-21
delete0
PRE
AI
Y
Yudi Zhang
唐
唐雪嵩 (Xue‐song Tang) *
K
Kuangrong Hao
DOI:10.1007/s11633-024-1531-3delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
The reasoning chain generated by the large language models (LLMs) during the reasoning process is often susceptible to illusions that lead to incorrect reasoning steps. Such misleading intermediate reasoning steps may trigger a series of errors. This phenomenon can be alleviated by using validation methods to obtain feedback and adjust the reasoning process, similar to the human reflective process. In this paper, we propose a collaborative reasoning framework for mathematical reasoning called CRMR, where a generator is responsible for generating structured intermediate reasoning and a verifier provides detailed feedback on each step of the reasoning. In particular, we formulate a rigorous form of structured intermediate reasoning called step-by-step rationale (SSR). We evaluated the CRMR framework not only on mathematical word problems but also conducted experiments using open-source and closed-source models with different parameter sizes independently. The results show that our method fully exploits the inference capabilities of the models and achieves significant results on the dataset compared to a single model.
Keywords:
Large language models
prompt engineering
natural language processing
cooperative reasoning
multi-step reasoning

Journal

Machine Intelligence Research cover
Machine Intelligence Research
IF:
8.7
Papers:
304
Citations:
882

Organization

D
Donghua University
Scholars:
2.0W
Papers: 1.4W
Citations: 2.9W
Cited Papers

Cited Papers

errShare
errSave
errShare
errSave
Parsing Algebraic Word Problems into Equations
err2015-12-01
err0
errOAAI
errRik Koncel-Kedziorski; Hannaneh Hajishirzi; Ashish Sabharwal; Oren Etzioni; Siena Dumas Ang
errShare
errSave
Measuring and Narrowing the Compositionality Gap in Language Models
err2023-01-01
err0
errOAAI
errOfir Press; Muru Zhang; Sewon Min; Ludwig Schmidt; Noah Smith; Mike Lewis
errShare
errSave
The Impact of Reasoning Step Length on Large Language Models
err2024-01-01
err0
PREAI
errMingyu Jin; Qinkai Yu; Dong Shu; Haiyan Zhao; Wenyue Hua; Yanda Meng; Yongfeng Zhang; Mengnan Du
errShare
errSave
Large Language Models are Better Reasoners with Self-Verification
err2023-01-01
err0
errOAAI
errYixuan Weng; Minjun Zhu; Fei Xia; Bin Li; Shizhu He; Shengping Liu; Bin Sun; Kang Liu; Jun Zhao
errShare
errSave
researcher View more