Applications of Item Response Theory in Digital Quiz-Based Games: a Rapid Review

Authors

DOI:

https://doi.org/10.18264/eadf.v16i1.2772

Keywords:

Digital games, Educational assessment, Item response theory, Quiz, Rapid review

Abstract

This study aims to investigate whether the application of Item Response Theory (IRT) contributes to a more accurate analysis of students’ performance in digital quiz-based games. The methodology was based on the Rapid Review, with searches conducted in the CAPES Journal Portal database. Out of 78 identified studies, 5 were selected according to the established criteria. The results indicate that Item Response Theory has the potential to overcome limitations of Classical Test Theory by considering parameters such as item difficulty and discrimination, enabling more detailed analyses of student performance. Thus, Item Response Theory appears to be a promising approach for improving assessment processes in digital educational contexts, although its application still faces practical challenges.

 

Keywords: Digital games. Educational assessment.Item response theory. Quiz. Rapid review.

Downloads

Download data is not yet available.

Author Biographies

Victor Lucas Dos Santos Fernandes, Centro Universitário São José

Holds a Bachelor’s degree in Information Systems from Centro Universitário São José (2021–2024). Has technical and vocational training in Information Technology and is currently pursuing a postgraduate degree in Project Management. Is an Undergraduate Researcher, supported by a FAPERJ scholarship, working in the fields of digital game development and Artificial Intelligence, and is a member of the Arena do Saber project, where he contributes to the design, development, and evaluation of a gamified educational platform based on multiplatform quizzes. Develops activities related to the integration of AI for the dynamic generation of questionnaires, user data analysis, and the enhancement of interactive experiences, using tools such as Lovable and Supabase. Has academic and professional experience in systems and web development, as well as IT support, having developed an educational game as his Undergraduate Thesis and worked in IT and infrastructure departments.

Marcos Antonio Gomes Xavier, Universidade Federal do Rio de Janeiro

PhD candidate in the Graduate Program in Informatics (PPGI) at the Federal University of Rio de Janeiro (UFRJ), within the research line of Management of Complex Systems.

     

Bruno Lopes Xavier, Instituto SENAI de Inovação em Sistemas Virtuais de Produção

Holds a Bachelor’s degree in Information Systems from UNESA (2014) and in Computer Systems from UFF (2012). Completed postgraduate studies in Software Architecture and Engineering at UNESA (2016), with a focus on Agile Development of Digital Games, and in Municipal Public Administration at UFF (2020), with a focus on Gamification of Occupational Regulatory Standards. Earned a Master’s degree in Information Systems from UNIRIO (2020), with research on Business Modeling for Independent Studios in Digital Game Software Ecosystems.

Has professional experience in the public sector, serving as a tenured IT specialist in the Brazilian Navy and the Municipality of the City of Rio de Janeiro. In the private sector, has worked with ItaHouse Informática, providing services and engaging in projects funded through public grants (FAPERJ, MinC, among others). Currently collaborates with the SENAI Innovation Institute for Virtual Production Systems (ISI SVP), working in the planning and execution of R&D&I projects in areas such as Virtual Reality, Augmented Reality, and Digital Games, applied to various industrial contexts in the State of Rio de Janeiro.

Paulo Victor Rodrigues de Carvalho, Universidade Federal do Rio de Janeiro

Paulo Victor Rodrigues de Carvalho is a researcher at the Nuclear Engineering Institute of the National Nuclear Energy Commission (IEN/CNEN) and a member of the ResiliSUS research group at the Strategic Studies Center of Fiocruz/RJ. He serves as a professor in the Graduate Program in Informatics (PPGI/UFRJ) at the Federal University of Rio de Janeiro, the Graduate Program in Nuclear Science and Technology at the Nuclear Engineering Institute (PPGIEN), and the Professional Master’s Program in New Technologies in Education at Centro Universitário Carioca. He is a CNPq Research Productivity Fellow (Level 1-D) and a Cientista do Nosso Estado fellow supported by FAPERJ.

He holds a Bachelor’s degree in Electronic Engineering from UFRJ, a Master’s degree in Electrical Engineering, and a PhD in Production Engineering from COPPE/UFRJ, with a focus on Ergonomics. His research interests include resilience engineering, ergonomics, and cognitive engineering, addressing topics such as modeling and safety of complex systems, information and communication technologies, and human–system interface design. He applies his research across several domains, including healthcare systems, industry, emergency and disaster management, and has authored over 100 journal articles, as well as book chapters and conference proceedings. He is co-leader of the Resilience Engineering Technical Group of the International Ergonomics Association, a member of the editorial board of Theoretical Issues in Ergonomic Science, a consultant for the funding agencies CAPES, CNPq, and FAPERJ, and a member of the Interdisciplinary Area Evaluation Committee of CAPES/MEC.

Marcio Sacramento de Oliveira, Fundação Oswaldo Cruz

Holds a Bachelor’s degree in Biological Sciences from the University of Grande Rio (2000), a Master’s degree in Parasitic Biology (2004), and a PhD in Public Health and Environment (2011), both from the Oswaldo Cruz Foundation (Fiocruz). Currently serves as Coordinator of the Graduate Program in Health Information and Communication (PPGICS) at the Institute of Scientific and Technological Communication and Information in Health (ICICT/Fiocruz). Additionally, is a Senior Researcher at the Laboratory of Scientific and Technological Information in Health (LICTS) and a permanent faculty member of the Master’s Program in Professional Health Education (PPGEPS) at the Joaquim Venâncio Polytechnic School of Health (EPSJV/Fiocruz). Is a member of the Research Ethics Committee of the Joaquim Venâncio Polytechnic School of Health (CEP EPSJV) and of the Epidemiology Committee of ABRASCO. Has experience in the fields of Education and Collective Health, with emphasis on Public Health and Environment, working mainly on the following themes: Professional Health Education, Health Surveillance, Environmental Health, Health Information, and Knowledge Management and Technical-Scientific Foresight in Health and Environment.

References

ANDRADE, D. F.; TAVARES, H. R.; VALLE, R. C. Teoria da Resposta ao Item: conceitos e aplicações. Associação Brasileira de Estatística, 2000. Disponível em: https://docs.ufpr.br/~aanjos/CE095/LivroTRI_DALTON.pdf - Acesso em: set. 2025.

BICHI, A.; TALIB, R. Item response theory: an introduction to latent trait models for test and item development. . International Journal of Evaluation and Research in Education (IJERE), v. 7, n. 2, 2018. DOI: https://doi.org/10.11591/ijere.v7i2.12900 - Acesso em: abr. 2026.

BORBA, E. H. de; TEZZA, R. Aplicação de escalas de teoria de resposta ao item na área de tecnologia da informação e comunicação. Revista de Tecnologia Aplicada (RTA), v. 11, n. 1, p. 21–33, jan./abr. 2022. DOI: https://doi.org/10.48005/2237-3713rta2022v11n1p2133 - Acesso em: jul. 2025.

CARTAXO, B.; PINTO, G. H.; SOARES, S. C. B.The role of rapid reviews in supporting decision-making in software engineering practice.EASE'18: International Conference on Evaluation and Assessment in Software Engineering. 2018. 24–34. DOI: https://doi.org/10.1145/3210459.3210462

HAMBLETON, R. K.; SWAMINATHAN, H.; ROGERS, H. J. Fundamentals of Item Response Theory.SagePublications, 1991.

JABRAYILOV, R.; EMONS, W.; SIJTSMA, K. Comparison of Classical Test Theory and Item Response Theory in Individual Change Assessment. Applied Psychological Measurement, [s. l.], v. 40, n. 8, p. 559-572, 2016. DOI: https://doi.org/10.1177/0146621616664046 - Acesso em: abr. 2026.

KORB, T.; ANDRADE, D. F. DE; FREIRE, P. D. S. A Teoria de Resposta ao Item Aplicada em Avaliações da Educação Profissional e Tecnológica: uma revisão sistemática da literatura. Revista Meta: Avaliação, v. 11, n. 33, p. 773, 13 dez. 2019. DOI: https://doi.org/10.22347/2175-2753v11i33.2095 -Acesso em: jul. 2025.

MONTEIRO, E. J. L. B.; LEITÃO, G. de S.; BARRETO, R. da S. Um Método Baseado na Teoria da Resposta ao Item para Avaliação e Feedback Automático no Contexto de Educação Digital. Revista Brasileira de Informática na Educação, [S. l.], v. 29, p. 746–774, 2021. DOI: https://doi.org/10.5753/rbie.2021.29.0.746 - Acesso em: jul. 2025.

PASQUALI, L. Psicometria. Rev. Esc. Enferm. USP. 2009; 43(Esp):992-9. DOI: https://doi.org/10.1590/S0080-6234200900050000 - Acesso em: set. 2025.

SANTOS, F. D.; GUEDES, L. G. de R. Testes adaptativos informatizados baseados em teoria de resposta ao item utilizados em ambientes virtuais de aprendizagem. RENOTE, Porto Alegre, v. 3, n. 2, 2005. DOI: https://doi.org/10.22456/1679-1916.14027 - Acesso em: jul. 2025.

TAVARES, C. Z. Teoria da resposta ao item: uma análise crítica dos pressupostos epistemológicos. Estudos em Avaliação Educacional, v. 24, n. 54, p. 56–76, 2013. DOI: https://doi.org/10.18222/eae245420131902 - Acesso em: set. 2025.

XAVIER, M. A. G. et al. Implementando quiz para aprendizagem da introdução à informática. Revista EDaPECI, São Cristóvão (SE), v.22, n.3, p. 47-62, set./dez. 2022. DOI: https://doi.org/10.29276/redapeci.2022.22.317901.47-62 - Acesso em: set. 2025.

ZAFFALON, F. et al. Estudo Comparativo entre Modelos que Estimam a Habilidade dos Estudantes em Ambientes Virtuais de Programação. Revista Brasileira de Informática na Educação, [S. l.], v. 28, p. 776–795, 2020. DOI: https://doi.org/10.5753/rbie.2020.28.0.776 - Acesso em: jul. 2025.

Downloads

Published

2026-05-25

How to Cite

Fernandes, V. L. D. S., Xavier, M. A. G., Xavier, B. L., Carvalho, P. V. R. de, & Oliveira, M. S. de. (2026). Applications of Item Response Theory in Digital Quiz-Based Games: a Rapid Review. EaD Em Foco, 16(1), e2772. https://doi.org/10.18264/eadf.v16i1.2772

Issue

Vol. 16 No. 1 (2026)

Section

Revisões

License

Copyright (c) 2026 EaD em Foco

Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.

All articles published in Revista EaD em Foco receive the license

Creative Commons - Atribuição 4.0 Internacional (CC BY 4.0).

All subsequent publications, complete or partial, must be made with the acknowledgment, in citations, of the Revista EaD em Foco as the original editor of the article.