arrow
Return

Human realignment

delete2026-08-17
delete0
delete
OA
AI
C
Christoph Engel *
Y
Yoan Hermstrüwer
A
Alison Kim
DOI:10.1007/s10506-026-09517-6delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Recent advances in AI make it conceivable to delegate legal decision-making to machines, or to enhance human adjudication through AI assistance. Using classic normative conflicts — the trolley problem and comparable moral dilemmas — as a proof of concept, we examine the alignment between AI legal reasoning and human judgment. In our baseline experiment, we find a pronounced mismatch between decisions made by GPT and those of human subjects. This misalignment raises substantive concerns for AI-powered legal decision-aids. We investigate whether explicit normative guidance can address this misalignment, with mixed results. GPT-3.5 is susceptible to such intervention, but frequently refuses to decide when faced with a moral dilemma. GPT-4 is outright utilitarian, and essentially ignores the instruction to decide on deontological grounds. GPT-o3-mini faithfully implements this instruction, but is unwilling to balance deontological and utilitarian concerns if instructed to do so. We replicate the experiment with four LLMs from different providers. Claude-sonnet-4.6 comes closest to human respondents. Gemini-2.5-flash-lite is most sensitive to normative instructions. Llama-4-scout and Mistral-nemo have a strong utilitarian bias, and do not strongly respond to normative interventions. At least for the time being, explicit normative instructions are not fully able to realign AI advice with the normative convictions of the population, or the legislator deciding on its behalf.
Keywords:
Large language models
Human-AI alignment
Rule of law
Moral dilemmas
Trolley problems

Journal

A
Artificial Intelligence and Law
IF:
3.1
Papers:
62
Citations:
2

Organization

L
Law Faculty
Scholars:
3
Papers: 2
Citations: 0
M
max planck institute for behavioral economics
Scholars:
4
Papers: 3
Citations: 0
Cited Papers

Cited Papers

Trolley problems in context
err2023-01-01
err0
errOAAI
errChristopher Shallow; Rumen Iliev; Douglas Medin
errShare
errSave
How artificial intelligence will affect the practice of law
err2018-01-01
err0
errOAAI
errBenjamin Alarie; Anthony Niblett; Albert H Yoon
errShare
errSave
Debiasing through Law
err2006-01-01
err0
PREAI
errChristine Jolls; Cass R. Sunstein
errShare
errSave
Moral Judgments of Human vs. AI Agents in Moral Dilemmas
err2023-02-16
err0
errOAAI
errYuyan Zhang; Jiahua Wu; Feng Yu; Liying Xu
errShare
errSave
Human Decisions in Moral Dilemmas are Largely Described by Utilitarianism: Virtual Car Driving Study Provides Guidelines for Autonomous Driving Vehicles
err2018-01-22
err0
PREAI
errAnja K. Faulhaber; Anke Dittmer; Felix Blind; Maximilian A. Wächter; Silja Timm; Leon R. Sütfeld; Achim Stephan; Gordon Pipa; Peter König
errShare
errSave
RATIONING LEGAL SERVICES
err2013-05-14
err22
errOAAI
errCohen, I. Glenn
errShare
errSave
A Theory of Justice
err
IF0
err2020-09-02
err0
PREAI
errJohn Rawls
errShare
errSave
researcher View more