Accuracy and Reliability of ChatGPT as perceived by Distance Learning Students
DOI:
https://doi.org/10.18264/eadf.v14i1.2111Keywords:
ChatGPT, Educational tool, College education, E-learning, Teaching-learning processAbstract
This study aimed to identify the understating of undergraduate students regarding the use of the ChatGPT tool, considering the accuracy of the answers, the reliability, its potential for learning and professional applications. To achieve this, an activity was proposed for undergraduate students enrolled at the Study Methods and Techniques discipline via distance learning, offered by a private higher education institution located in Baixada Fluminense, in the city of Rio de Janeiro. This subject is offered in all undergraduate courses throughout the third period. The activity developed consisted of using the tool to respond to theoretical concepts in their area of expertise and then to answer a questionnaire with objective and discursive questions. A total of 47 responses were obtained, which were investigated and interpreted in light of qualitative content analysis. As a result, it was demonstrated that the interviewees perceived the usefulness of the AI tool, but they identified ethical issues related to its usage, as well as possible challenges related to the development of learning.
Keywords: ChatGPT. Educational tool. Teaching-learning process. College education. E-learning.
Downloads
References
BAUER, M. W. e Gaskell. Pesquisa Qualitativa com texto, imagem e som: um manual prático. 13.ed. Petrópolis, RJ: Vozes, 2015.
BARDIN, L. Análise de conteúdo. São Paulo: Edições 70, 2011.
BILGRAM V. e LAARMANN F. Accelerating Innovation with Generative AI: AI-augmented Digital Prototyping and Innovation Methods," in IEEE Engineering Management Review.
BOULAY, B.t du. Inteligência artificial na educação e ética. RE@ D–Revista de Educação a Distância e eLearning. p. e202301, 2023.
BOZKURT, A; SHARMA, R. C. Generative AI and prompt engineering: The art of whispering to let the genie out of the algorithmic world. Asian Journal of Distance Education, 2023.
CAMARGO, F. R. B. IoT na EaD: fatores na aceitação pelos discentes. 2021. Tese de Doutorado.
CAMPOS, C. J. G.. Método de análise de conteúdo. Ferramenta para análise de dados qualitativos no campo da Saúde. Revista Brasileira de Enfermagem. Brasília, 57 (5), set./out., 611-14, 2004.
CARLEO, G., et al., "Machine learning and the physical sciences", Reviews of Modern Physics, vol. 91, no. 4, pp. 045002, 2019.
CASTELLS, M.. A obsolescência da Educação. 7 de abr de 2014. Disponível em https://youtu.be/eb0cNrE3I5g - Acesso em 28/09/2023.
COSTA JÚNIOR, J. F. et al. A inteligência artificial como ferramenta de apoio no ensino superior. Revista Brasileira de Ensino e Aprendizagem, v. 6, p. 246-269, 2023.
DENG, M, et al. "Compression transduction and creation: A unified framework for evaluating natural language generation", Proc. of the 2021 Conference on Empirical Methods in Natural Language Processing, pp. 7580-7605, 2021.
Garcia, A. C.. Ética e inteligência artificial. Computação Brasil, n. 43, p. 14-22, 2020.
DO NASCIMENTO, C. C., et al. Inteligência Artificial no Ensino Superior: da Transformação Digital aos Desafios da Contemporaneidade. Publicações, 2023.
GERHARDT. T. E.; SILVEIRA, D. T. Métodos de pesquisa. [Organizado por] Tatiana Engel Gerhardt e Denise Tolfo Silveira; coordenado pela Universidade Aberta do Brasil–UAB/UFRGS e pelo Curso de Graduação Tecnológica–Planejamento e Gestão para o Desenvolvimento Rural da SEAD/UFRGS. Porto Alegre: Editora da UFRGS, 2009.
KHOSLA R. e DILLON,T. S. "Welding symbolic AI systems with neural networks and their applications," 1998 IEEE International Joint Conference on Neural Networks Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98CH36227), Anchorage, AK, USA, 1998, pp. 29-34 vol.1.
KATOCH, S., S. CHAUHAN E KUMAR, V."A review on genetic algorithm: past present and future", Multimedia Tools and Applications, vol. 80, pp. 8091-8126, 2021.
LOOS, E.; GRÖPLER, J.; GOUDEAU, M. S. Usando ChatGPT na Educação: Reflexão Humana sobre a Auto-Reflexão do ChatGPT. Sociedades , v. 13, n. 8, pág. 196, 2023.
LUO Y. et al. "Natural language to visualization by neural machine translation", IEEE Trans. Vis. Comput. Graphics, vol. 28, no. 1, pp. 217-226, Jan. 2022.
MADDIGAN, P. ; SUSNJAK, T. "Chat2VIS: Generating Data Visualizations via Natural Language Using ChatGPT, Codex and GPT-3 Large Language Models," in IEEE Access, vol. 11, pp. 45181-45193, 2023.
MISHRA M. e SRIVASTAVA, M. "A view of Artificial Neural Network", 2014 International Conference on Advances in Engineering & Technology Research (ICAETR -2014), 2014
NGGUYEN, L. "Integrating the Probabilistic Uncertainty to Fuzzy Systems in Fuzzy Natural Logic", 12th International Conference on Knowledge and Systems Engineering (KSE), pp. 142-146, 2020.
OLIVEIRA, H. P. C. de. Arquitetura da informação pervasiva: contribuições conceituais. 2014.
SANTOS Jr., F. D. dos et al. Inteligência Artificial e Educação Especial: Desafios Éticos. In: WORKSHOP DE DESAFIOS DA COMPUTAÇÃO APLICADA À EDUCAÇÃO (DESAFIE!), 8. , 2019, Brasília.
PEREIRA, A.; GOMES, A. S.; PRIMO, T. T. Desvendando a Resistência e as Estratégias dos Tutores Humanos para Engajar Estudantes no Aprendizado Online. Cadernos de Educação Tecnologia e Sociedade, v. 16, n. 3, p. 551-566, 2023. https://www.brajets.com/index.php/brajets/article/view/1100
PINTO, A. L. da S. et al. Avaliação da aceitação das ferramentas tecnológicas no ambiente do trabalho docente. Revista Gestão Universitária na América Latina-GUAL, v. 12, n. 2, p. 118-138, 2019.
RIOS, S., ZHANG Y. ; ARAUJO OLIVEIRA, E. (2023). Authorship Verification in Software Engineering Education: Forget ChatGPT and Focus on Students' Academic Writing Profiles. ASCILITE 2023: 40th International Conference on Innovation, Practice and Research in the Use of Educational Technologies in Tertiary Education, ASCILITE.
TEIXEIRA, J. (2019). O que é inteligência artificial. E-galáxia. UNIVERSITY of LOUISIANA at LAFAYETTE (UL Lafayette). Generative AI & ChatGPT. 2023. Disponível em: https://distancelearning.louisiana.edu/teach-online-hybrid/best-practices-online-education/generative-ai. Acesso em: 20 dez. 2023.
UHRIG, R. E. Introduction to artificial neural networks. In: Proceedings of IECON '95 -21st Annual Conference on IEEE Industrial Electronics.
VICARI, R. M.. Tendências em inteligência artificial na educação no período de 2017 a 2030: sumário executivo. 2018.
WYK, V.; ADARKWAH, M. M. A.; e AMPONSAH, S. (2023). Why All the Hype about ChatGPT? Academics’ Views of a Chat-based Conversational Learning Strategy at an Open Distance e-Learning Institution. Open Praxis, 15(3), pp. 214–225. DOI: https://doi.org/10.55982/ openpraxis.15.3.563 https://search.informit.org/doi/pdf/10.3316/informit.378033000103803
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2024 EaD em Foco
This work is licensed under a Creative Commons Attribution 4.0 International License.
All articles published in Revista EaD em Foco receive the license
Creative Commons - Atribuição 4.0 Internacional (CC BY 4.0).
All subsequent publications, complete or partial, must be made with the acknowledgment, in citations, of the Revista EaD em Foco as the original editor of the article.
