Evaluating and improving LLM-based competitive program generation

doi:10.1016/j.infsof.2025.107977

Evaluating and improving LLM-based competitive program generation

2025-11-24

0

PRE

AI

DOI：10.1016/j.infsof.2025.107977

Original

Original request for help

Save

Abstract

En 中文

Due to the demand for strong algorithmic reasoning, complex logic implementation, and strict adherence to input/output formats and resource constraints, competitive programming generation by large language models (LLMs) is considered the most challenging problem in current LLM-based code generation. However, previous studies often evaluate LLMs using simple prompts and benchmark datasets prone to data leakage. Moreover, prior work has limited consideration of the diversity in algorithm types and difficulty levels.

Evaluating and improving LLM-based competitive program generation

Abstract

Journal

Organization