1
Return

Reasoning beyond limits: Advances and open problems for LLMs

delete2025-09-22
delete0
delete
OA
AI
M
Mohamed Amine Ferrag *
N
Norbert Tihanyi
M
Mérouane Debbah
DOI:10.1016/j.icte.2025.09.003delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Recent breakthroughs in generative reasoning have fundamentally reshaped how large language models (LLMs) address complex tasks, enabling them to dynamically retrieve, refine, and organize information into coherent, multi-step reasoning chains. Techniques such as inference-time scaling, reinforcement learning, supervised fine-tuning, and distillation have been effectively applied to state-of-the-art models, including DeepSeek-R1, OpenAI’s o1 and o3, GPT-4o, Qwen-32B, and various Llama variants, significantly enhancing their reasoning capabilities. In this paper, we present a comprehensive review of the top 27 LLMs released between 2023 and 2025, such as Mistral AI Small 3 24B, DeepSeek-R1, Search-o1, QwQ-32B, and Phi-4, and analyze their core innovations and performance improvements.
Keywords:
Large language model
Reinforcement learning
Reasoning
Retrieval Augmented Generation
Chain-of-thought
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

ICT Express cover
ICT Express
IF:
4.2
Papers:
960
Citations:
2.5K

Organization

K
Khalifa University of Science and Technology
Scholars:
1.2K
Papers: 557
Citations: 4
U
United Arab Emirates University
Scholars:
8.4K
Papers: 7.1K
Citations: 10.0K
T
Technology Innovation Institute
Scholars:
585
Papers: 513
Citations: 615
Cited Papers

Cited Papers

Citing Papers

Citing Papers