.png){kind=icon}
.png){kind=icon}
Return
Human Morality Difference when Programming and Actually Operating Autonomous Machines
.png){kind=icon}
PRE
AI
DOI：10.26599/TST.2024.9010062.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
Autonomous machines (AMs) are poised to possess human-like moral cognition, yet their morality is often pre-programmed for safety. This raises the question of whether the morality intended by programmers aligns with their actions during actual operation, a crucial consideration for a future society with both humans and AMs. Investigating this, we use a micro-robot swarm in a simulated fire scenario, with 180 participants, including 102 robot programmers, completing moral questionnaires and participating in virtual escape trials. These exercises mirror common societal moral dilemmas. Our comparative analysis reveals a morality gap between programming presets and real-time operation, primarily influenced by uncertainty about the future and heightened by external pressures, especially social punishment. This discrepancy suggests that operational morality can diverge from programmed intentions, underlining the need for careful AM design to foster a collaborative and efficient society.
Keywords:
Ethics
Uncertainty
Decision making
Programming
Real-time systems
Safety
Stakeholders
Mirrors
Machinery
Stress
moral machines
moral level
autonomous machines (AMs)
emergency evacuation
robot crowd
Journal
T
IF:
3.5
Papers:
987
Citations:
2.5K