1
Return

AI Is a Friend, a Teammate, Not a Supervisor: Understanding Human Perceptions of AI Teammates' Monitoring in Human-AI Teams

delete2026-03-01
delete0
PRE
AI
W
Weng, Nan *
D
Duan, Wen
N
Nguyen, Han
W
Wang, Yunhao
M
McNeese, Nathan
DOI:10.1145/3799437delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Artificial Intelligence (AI)-mediated collaboration has been a core research interest in CSCW and HCI in recent decades. AI is being embedded in teams as a teammate, known as human-AI teamwork. A critical aspect to this and any type of teamwork is monitoring: the ability to track and be aware of both team-and individual-level actions. As AI continuously evolves from a passive tool into a supportive collaborator capable of playing a role in teams, more research is needed to investigate human perceptions of AI teammates' monitoring. More work is needed on when and how AI can function as a supportive collaborator rather than a surveillant (in regard to monitoring) to enhance team coordination and performance. Drawing on 22 interviews, we examined how humans perceive AI monitoring when AI behaves as a collaborative teammate for team support, focusing on perceptions of AI monitoring at both team and individual levels. Four tensions have been identified, namely: performance versus privacy, support versus control, fairness versus empathy, and team-level and individual-level trade-offs. We also propose feasible design principles for human-AI teaming designers to optimize AI monitoring for effective team support, maximizing its unique advantages while mitigating potential risks, further cultivating more effective and trustworthy human-AI collaboration.
Keywords:
Human-AI Collaboration
Human-AI Teamwork
AI Monitoring
AI Teammate Design
Qualitative Methods

Journal

P
PROCEEDINGS OF THE ACM ON HUMAN COMPUTER INTERACTION
IF:
0
Papers:
392
Citations:
0

Organization

C
Clemson University
Scholars:
1.2W
Papers: 1.1W
Citations: 1.4W
Cited Papers

Cited Papers

Citing Papers

Citing Papers