Decision Deferral in a Human-AI Joint Face-Matching Task: Effects on Human Performance and Trust

Pouria Salehi, Erin K. Chiou, Michelle Mancenido, Ahmadreza Mosallanezhad, Myke C. Cohen, Aksheshkumar Shah

Research output: Contribution to journalConference articlepeer-review

Abstract

This study investigates how human performance and trust are affected by the decision deferral rates of an AI-enabled decision support system in a high criticality domain such as security screening, where ethical and legal considerations prevent full automation. In such domains, deferring cases to a human agent becomes an essential process component. However, the systemic consequences of the rate of deferrals on human performance are unknown. In this study, a face-matching task with an automated face verification system was designed to investigate the effects of varying deferral rates. Results show that higher deferral rates are associated with higher sensitivity and higher workload, but lower throughput and lower trust in the AI. We conclude that deferral rates can affect performance and trust perceptions. The tradeoffs between deferral rate, sensitivity, throughput, and trust need to be considered in designing effective human-AI work systems.

Original languageEnglish (US)
Pages (from-to)638-642
Number of pages5
JournalProceedings of the Human Factors and Ergonomics Society
Volume65
Issue number1
DOIs
StatePublished - 2021
Externally publishedYes
Event65th Human Factors and Ergonomics Society Annual Meeting, HFES 2021 - Baltimore, United States
Duration: Oct 3 2021Oct 8 2021

ASJC Scopus subject areas

  • Human Factors and Ergonomics

Fingerprint

Dive into the research topics of 'Decision Deferral in a Human-AI Joint Face-Matching Task: Effects on Human Performance and Trust'. Together they form a unique fingerprint.

Cite this