The impact of AI errors in a human-in-the-loop process

Vista sencilla de ítem
dc.contributor.authorAgudo Díaz, Ujué
dc.contributor.authorLiberal, Karlos G.
dc.contributor.authorArrese, Miren
dc.contributor.authorMatute, Helena
dc.date.accessioned2025-05-14T08:30:45Z
dc.date.available2025-05-14T08:30:45Z
dc.date.issued2024-01-07
dc.date.updated2025-05-14T08:30:45Z
dc.description.abstractAutomated decision-making is becoming increasingly common in the public sector. As a result, political institutions recommend the presence of humans in these decision-making processes as a safeguard against potentially erroneous or biased algorithmic decisions. However, the scientific literature on human-in-the-loop performance is not conclusive about the benefits and risks of such human presence, nor does it clarify which aspects of this human–computer interaction may influence the final decision. In two experiments, we simulate an automated decision-making process in which participants judge multiple defendants in relation to various crimes, and we manipulate the time in which participants receive support from a supposed automated system with Artificial Intelligence (before or after they make their judgments). Our results show that human judgment is affected when participants receive incorrect algorithmic support, particularly when they receive it before providing their own judgment, resulting in reduced accuracy. The data and materials for these experiments are freely available at the Open Science Framework: https://osf.io/b6p4z/ Experiment 2 was preregistereden
dc.description.sponsorshipSupport for this research was provided by Grant PID2021-126320NB-I00 funded by the Spanish Government MCIN/AEI/10.13039/501100011033 and by ERDF A way of making Europe, as well as by Grant IT1696-22 from the Basque Government, both awarded to HMen
dc.identifier.citationAgudo, U., Liberal, K. G., Arrese, M., & Matute, H. (2024). The impact of AI errors in a human-in-the-loop process. Cognitive Research: Principles and Implications, 9(1). https://doi.org/10.1186/S41235-023-00529-3
dc.identifier.doi10.1186/S41235-023-00529-3
dc.identifier.eissn2365-7464
dc.identifier.urihttp://hdl.handle.net/20.500.14454/2746
dc.language.isoeng
dc.publisherSpringer Science and Business Media Deutschland GmbH
dc.rights© The Author(s) 2023
dc.subject.otherAI
dc.subject.otherArtificial intelligence
dc.subject.otherAutomation bias
dc.subject.otherCompliance
dc.subject.otherDecision-making
dc.subject.otherHuman-in-the-loop
dc.subject.otherHuman–computer interaction
dc.titleThe impact of AI errors in a human-in-the-loop processen
dc.typejournal article
dcterms.accessRightsopen access
oaire.citation.issue1
oaire.citation.titleCognitive Research: Principles and Implications
oaire.citation.volume9
oaire.licenseConditionhttps://creativecommons.org/licenses/by/4.0/
oaire.versionVoR
Archivos
Bloque original
Mostrando 1 - 1 de 1
Miniatura
Nombre:
agudo_impact_2024.pdf
Tamaño:
1.85 MB
Formato:
Adobe Portable Document Format
Descargar
Colecciones
Artículos