Instrument for User Experience Assessment in Distance Higher Education Services

Authors

DOI:

https://doi.org/10.18264/eadf.v14i1.2214

Keywords:

Service design, User experience, Higher distance education

Abstract

Considering the expansion of Higher Distance Education (ESaD) and the need for its evaluation through validated instruments, this research sought to propose an instrument aimed at measuring the User Experience (Ux) of such services. The research is characterized as applied, qualiquantitative, exploratory and descriptive, being composed of (I) Theoretical stage (mapping of dimensions and Ux factors); (II) Definition of the pilot instrument (mapping of personas and experience map, definition of the construct and pilot model, validation of the content with specialists (n=8) and users (n=12) and (III) Validation (application of the instrument (n=181), factor analysis and internal consistency). As a result, the EASE-Ux (User Experience E-Learning Service Assessment Scale) was proposed, consisting of 31 items divided into the dimensions of Central Elements (items related to the hub's technological structure, Tutoring, Disciplines and content, Didactic material and Final image) and Support elements (items related to Communication, Processes, Technology, Support, Physical structure of the pole and Preview image). Validity and reliability analyzes allow us to say that the instrument concisely measures the construct and can provide data aimed at improving the service. The study also contributes to the Ux and services literature, opening possibilities for new related research.  

 

Keywords: Service design. Higher distance education. User experience.

Downloads

Download data is not yet available.

Author Biography

Bruno Bertagnolli, Universidade do Estado de Santa Catarina

Graduado em Desenho Industrial - Programação Visual pela Universidade Federal de Santa Maria (2006); Especializado em Marketing pela Fundação Getúlio Vargas (2009); Mestre em Design pela Universidade do Estado de Santa Catarina (2019); Doutorando em Design pela Universidade do Estado de Santa Catarina (2020). Atualmente lotado no setor de Marketing e Jornalismo do Instituto Federal de Santa Catarina como Coordenador de Programação Visual (2020 -) . Possui experiência na área de Desenho Industrial, com ênfase em Programação Visual, Comunicação e Marketing.

References

BEHAR, P. A. Modelos Pedagógicos em Educação a Distância. Porto Alegre: Artmed, 2009.

BROWN, T. Design Thinking. Harvard Business Review, Vol. 86, n.6, p. 84-92. 2008.

Carvalho, J. J. et al. A concorrência schumpeteriana de mercado na oferta de serviços educacionais de ensino superior. Brazilian Journal of Development, v.6, n.9, p.73436–73454. 2020.

FERRANDO, P. J.; LORENZO-SEVA, U. Assessing the quality and appropriateness of factor solutions and factor score estimates in exploratory item factor analysis. Educational and Psychological Measurement, n.78, pp. 762-780. 2018.

FITZSIMMONS, J.; FITZSIMMONS, M. Administração de Serviços: operações estratégias e tecnologia de informações. São Paulo: Bookman 2014.

GOODMAN, E.; KUNIAVSKY, M.; MOED, A. Observing the user experience: a practitioner's guide to user research. 2 ed. Amsterdam: Elsevier, Morgan Kaufmann, 2012.

HAN, S. et al. Usability of consumer electronic products. International Journal of Industrial Ergonomics. v. 28, p. 143–151, 2001.

HAIR, J.F. et al. Multivariate Data Analysis. 8 ed., Cengage Learning, Londres. 2018.

HERNÁNDEZ-NIETO, R. A. Contributions to Statistical Analysis. Mérida: Universidad de Los Andes. 119p. 2002.

INEP. Instituto Nacional de Estudos e Pesquisas Anísio Teixeira. Censo da Educação Superior 2019. Disponível em: https://www.gov.br/inep/pt-br/areas-de-atuacao/pesquisas-estatisticas-e-indicadores/censo-da-educacao-superior/resultados - Acesso em: 02 dez. de 2022.

INEP. Instituto Nacional de Estudos e Pesquisas Anísio Teixeira. Censo da Educação Superior 2020. Disponível em: https://www.gov.br/inep/pt-br/areas-de-atuacao/pesquisas-estatisticas-e-indicadores/censo-da-educacao-superior/resultados - Acesso em: 15 mar. de 2023.

KRIPPENDORFF, K. The semantic turn: a new foundation for design. Boca Raton: Taylor&Francis, 2006.

LUNA, F. D. S. Instituições de ensino superior brasileiras e sua jornada para a transformação digital. Dissertação (Mestrado em Empreendedorismo) - Faculdade de Economia, Administração e Contabilidade, Universidade de São Paulo, São Paulo, 2020.

MAGER, B. Service Design as an emerging field. In: MIETTINEN, S.; KOIVISTO, M. (Ed.). Designing Services with innovative methods. Keuruu: University of Art and Design Helsinki, v.1, p.28-43. 2009.

MINAYO, M. C. S. et al. Métodos, técnicas e relações em triangulação. In. MINAYO, M. C. de S.; ASSIS, S. G.; SOUZA, E. R. Avaliação por triangulação de métodos: abordagem de programas sociais. Rio de Janeiro; Editora Fiocruz, 2005, p.71-104.

MOORE, M.; KEARSLEY, G. Educação a Distância: sistemas de aprendizagem on-line. São Paulo: Cengage Learning, 2013.

NIELSEN, J.; NORMAN, D. The Definition of User Experience. In: Nielsen Norman Group. Evidence-Based User Experience Research, Training, and Consulting. [site]. Fremont, CA, 2014. Disponível em: https://www.nngroup.com/articles/definition-user-experience - Acesso em: 20 jan. de 2021.

PARASURAMAN, A. et al. A conceptual model of service quality and its implications for future research. Journal of Marketing, vol. 49, n.4, p. 41-50, 1985.

PASQUALI, L. Princípios de Elaboração de Escalas Psicológicas. Revista de Psiquiatria Clínica, v. 25, n. 5, p. 206–213, 1998.

PASQUALI, L. Psicometria: Teoria dos testes na psicologia e na educação. 7. ed. Petrópolis: Vozes, 2017.

RAMOS, M. et al. Design de Serviços e Experiência do Usuário (UX): uma análise do relacionamento das áreas. DAPesquisa, v.11, n.16, p.105-1023, agosto 2016.

RIVERO, L.; CONTE, T. A systematic mapping study on research contributions on UX evaluation technologies. In.: Proceedings of the 16th Brazilian Symposium on Human Factors in Computing Systems (IHC), Joinville, Brazil. 2017.

ROSA, G. S.; GUIMARÃES, T. B. C; GODINHO, L. A. C. Da gestão da inovação ao design de serviços: articulações e conexões. Curitiba, v. 5, n.11, p.24415-24438, nov. 2019.

ROSSITER, J. The C-OAR-SE procedure for scale development in marketing. International Journal of Research in Marketing, 19(4), 305-335. 2002.

SAFFER, D. Designing for interaction: creating smart application and clever devices. Berkeley: New Riders, 2007.

SCHIFFERSTEIN, H.; HEKKERT, P. Product Experience. London: Elsevier, 2008.

TULLIS T., ALBERT B. Measuring the User Experience. Amsterdam: Morgan Kauffman, 2013.

VÄÄNÄNEN-VAINIO-MATTILA, K.; SEGERSTÅHL, K. A Tool for Evaluating Service User eXperience (ServUX): Development of a Modular Questionnaire. Interact 2009 conference, User Experience Evaluation Methods in Product Development (UXEM'09), Workshop in Interact'09 conference, Uppsala, Sweden, 2009.

ZEITHAML, V. A.; BITNER, M. J.; GREMLER, D. D. Marketing de serviços: a empresa com foco no cliente, 6. ed. Porto Alegre: AMGH Editora, 2014.

Downloads

Published

2024-04-17

How to Cite

Bertagnolli, B., & Mager, G. B. (2024). Instrument for User Experience Assessment in Distance Higher Education Services. EaD Em Foco, 14(1), e2214. https://doi.org/10.18264/eadf.v14i1.2214

Issue

Vol. 14 No. 1 (2024)

Section

Original Articles

License

Copyright (c) 2024 EaD em Foco

Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.

All articles published in Revista EaD em Foco receive the license

Creative Commons - Atribuição 4.0 Internacional (CC BY 4.0).

All subsequent publications, complete or partial, must be made with the acknowledgment, in citations, of the Revista EaD em Foco as the original editor of the article.