.png){kind=icon}
返回
Mathematical Language Models: A Survey
.png){kind=icon}
PRE
AI
DOI：10.1145/3773985.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
In recent years, there has been remarkable progress in leveraging Language Models (LMs), encompassing Pre-trained Language Models (PLMs) and Large-scale Language Models (LLMs), within the domain of mathematics. This article conducts a comprehensive survey of mathematical LMs, systematically categorizing pivotal research endeavors from two distinct perspectives: tasks and methodologies. The landscape reveals a large number of proposed mathematical LLMs, which are further delineated into instruction learning, tool-based methods, fundamental CoT techniques, advanced CoT methodologies, and multi-modal methods. To comprehend the benefits of mathematical LMs more thoroughly, we carry out an in-depth contrast of their characteristics and performance. In addition, our survey entails the compilation of over 60 mathematical datasets, including training datasets, benchmark datasets, and augmented datasets. Addressing the primary challenges and delineating future trajectories within the field of mathematical LMs, this survey is poised to facilitate and inspire future innovation among researchers invested in advancing this domain.
Keyword:
Mathematics
language models
pre-trained
LLMs
survey
期刊
IF:
28
论文数:
2.4K
被引数:
3.5W
机构
引用论文
MathAttack: Attacking Large Language Models towards Math Solving AbilityMathAttack：针对数学解题能力的攻击大型语言模型
OAAI
OAAI分享收藏Automatic Generation of Socratic Subquestions for Teaching Math Word Problems苏格拉底式子问题的自动生成：用于数学文字题的教学OAAI
OAAI分享收藏Tree of Uncertain Thoughts Reasoning for Large Language Models.png)
ICASSP 2024 - 2024 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
ICASSP 2024 - 2024 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)IF0
PREAI
分享收藏A neural network solves, explains, and generates university math problems by program synthesis and few-shot learning at human level神经网络通过人类水平的程序合成和少量学习来解决，解释和生成大学数学问题
OAAI
OAAI分享收藏Trung, L., Zhang, X., Jie, Z., Sun, P., Jin, X., and Li, H. (2024). REFT: reasoning with reinforced fine-tuning. In Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics, pp. 7601-7614.Trung, L., Zhang, X., Jie, Z., Sun, P., Jin, X., and Li, H. (2024). REFT: 基于强化微调的推理. 在第62届计算语言学协会年会议程中，第7601-7614页。
IF0
PREAI
分享收藏
查看更多内容