arrow
Return

Increasing alignment of large language models with language processing in the human brain

delete2025-09-16
delete0
delete
OA
AI
C
Changjiang Gao
Z
Z. Ma
J
Jiajun Chen
黎萍 cover
黎萍 (Ping Li)
S
Shujian Huang *
J
Jixing Li *
DOI:10.1038/s43588-025-00863-0delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Transformer-based large language models (LLMs) have considerably advanced our understanding of how meaning is represented in the human brain; however, the validity of increasingly large LLMs is being questioned due to their extensive training data and their ability to access context thousands of words long. In this study we investigated whether instruction tuning—another core technique in recent LLMs that goes beyond mere scaling—can enhance models’ ability to capture linguistic information in the human brain. We compared base and instruction-tuned LLMs of varying sizes against human behavioral and brain activity measured with eye-tracking and functional magnetic resonance imaging during naturalistic reading. We show that simply making LLMs larger leads to a closer match with the human brain than fine-tuning them with instructions. These finding have substantial implications for understanding the cognitive plausibility of LLMs and their role in studying naturalistic language comprehension. Larger LLMs’ self-attention more accurately predicts readers’ regressive saccades and fMRI responses in language regions, whereas instruction tuning adds no benefit.
Keywords:
Large language models
Instruction tuning
Human brain
Naturalistic reading
Cognitive plausibility
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Nature Computational Science cover
Nature Computational Science
IF:
18.3
Papers:
3.1K
Citations:
4.0K

Organization

C
City University of Hong Kong
Scholars:
2.3W
Papers: 3.0W
Citations: 6.1W
N
nanjing university
Scholars:
7.7W
Papers: 5.6W
Citations: 87
T
The Hong Kong Polytechnic University
Scholars:
5.1K
Papers: 3.0K
Citations: 17
researcher View more organizations