Using eye-tracking data to examine response processes in digital competence assessment for validation purposes

Vista sencilla de ítem
dc.contributor.authorBartolomé Boloix, Juan Carlos
dc.contributor.authorGaraizar, Pablo
dc.contributor.authorLoizaga Garmendia, Erlantz
dc.contributor.authorBastida Merino, Leire
dc.date.accessioned2025-02-27T14:56:25Z
dc.date.available2025-02-27T14:56:25Z
dc.date.issued2025-02
dc.date.updated2025-02-27T14:56:25Z
dc.description.abstractBackground: When measuring complex cognitive constructs, it is crucial to correctly design the evaluation items in order to trigger the intended knowledge and skills. Furthermore, assessing the validity of an assessment requires considering not only the content of the evaluation tasks, but also how examinees perform by engaging construct-relevant response processes. Objectives: We used eye-tracking techniques to examine item response processes in the assessment of digital competence. The eye-tracking observations helped to fill an ‘explanatory gap’ by providing data on the variation in response processes that cannot be captured by other common sources. Method: Specifically, we used eye movement data to validate the inferences made between claimed and observed behavior. This allowed us to interpret how participants processed the information in the items in terms of Area Of Interest (their size, placement, and order). Results and Conclusions: The gaze data provide detailed information about response strategies at the item level, profiling the examinees according to their engagement, response processes and performance/success rate. The presented evidence confirms that the response patterns of the participants who responded well do not represent an alternative to the interpretation of the results that would undermine the assessment criteria. Takeaways: Gaze-based evidence has great potential to provide complementary data about the response processes performed by examinees, thereby contributing to the validity argument.en
dc.identifier.citationBartolomé, J., Garaizar, P., Loizaga, E., & Bastida, L. (2025). Using Eye-Tracking Data to Examine Response Processes in Digital Competence Assessment for Validation Purposes. Applied Sciences (Switzerland), 15(3). https://doi.org/10.3390/APP15031215
dc.identifier.doi10.3390/APP15031215
dc.identifier.eissn2076-3417
dc.identifier.urihttp://hdl.handle.net/20.500.14454/2388
dc.language.isoeng
dc.publisherMultidisciplinary Digital Publishing Institute (MDPI)
dc.rights© 2025 by the authors
dc.subject.otherComputer-based assessment
dc.subject.otherDigital competence
dc.subject.otherEye tracking
dc.subject.otherHuman computer interaction
dc.subject.otherResponse process validity
dc.titleUsing eye-tracking data to examine response processes in digital competence assessment for validation purposesen
dc.typejournal article
dcterms.accessRightsopen access
oaire.citation.issue3
oaire.citation.titleApplied Sciences (Switzerland)
oaire.citation.volume15
oaire.licenseConditionhttps://creativecommons.org/licenses/by/4.0/
oaire.versionVoR
Archivos
Bloque original
Mostrando 1 - 1 de 1
Miniatura
Nombre:
bartolome_using_2025.pdf
Tamaño:
8.05 MB
Formato:
Adobe Portable Document Format
Descargar
Colecciones
Artículos