USABILITY EVALUATION OF THE "MATHEARENA" EDUCATIONAL APPLICATION: A CASE STUDY IN SERBIA

Jovana Medić

doi:10.24867/31GI02Medic

Industrijsko inženjerstvo i inženjerski menadžment

God. 40 Br. 08 (2025): Zbornik radova Fakulteta tehničkih nauka

ЕВАЛУАЦИЈА УПОТРЕБЉИВОСТИ ОБРАЗОВНЕ АПЛИКАЦИЈЕ "MATHEARENA": СТУДИЈА СЛУЧАЈА У СРБИЈИ

Jovana Medić

31GI02Medic.pdf (Engleski)

DOI:: https://doi.org/10.24867/31GI02Medic
Predato: July 23, 2025
Objavljeno: 2026-01-02

Apstrakt

Ова студија оцењује употребљивост образовне апликације „MatheArena“, дизајниране за побољшање математичких вештина, коришћењем методе „Usability Platform Test“. Студија је спроведена у оквиру пројекта „EdTech Talents“, док је тестирање извршено са ученицима осмог разреда основне школе у Апатину, у Републици Србији. Идентификовани су главни изазови у навигацији, комуникацији, дизајну и техничком квалитету. Иако су задовољство корисника и напредак у учењу високо оцењени, потребна су побољшања у локализацији језика и усклађености садржаја са локалним наставним плановима. Студија истиче значај тестирања употребљивости и препоручује унапређење техничких перформанси, локализацију садржаја и додавање функција праћења напретка ради повећања ангажованости ученика.

Reference

[1] P. Vlachogianni and N. Tselios, "Perceived Usability Evaluation of Educational Technology Using the Post-Study System Usability Questionnaire (PSSUQ): A Systematic Review," Sustainability, vol. 15, no. 17, pp. 1-15, 2023. DOI: 10.3390/su151712954.
[2] M. F. Costabile, M. De Marsico, R. Lanzilotti, V. L. Plantamura, and T. Roselli, "On the Usability Evaluation of E-Learning Applications," in Proc. 38th Hawaii Int. Conf. System Sciences (HICSS), 2005, pp. 6b-6b. DOI: 10.1109/HICSS.2005.468.
[3] V. Chang, "Review and Discussion: E-Learning for Academia and Industry," Int. J. Inf. Manage., vol. 36, no. 3, pp. 476-485, Jun. 2016. DOI: 10.1016/j.ijinfomgt.2015.12.007.
[4] S. Criollo-C, A. Guerrero-Arias, Á. Jaramillo-Alcázar, and S. Luján-Mora, "Mobile Learning Technologies for Education: Benefits and Pending Issues," Appl. Sci., vol. 11, no. 9, pp. 4111-4123, May 2021. DOI: 10.3390/app11094111.
[5] P. Bourges-Waldegg, L. Moreno, and T. Rojano, "The Role of Usability in the Implementation and Evaluation of Educational Technology," in Proc. 33rd Annu. Hawaii Int. Conf. System Sciences (HICSS), 2000, pp. 7-pp. DOI: 10.1109/HICSS.2000.926722.
[6] G. Connan et al., "Online Education for Gluten-Free Diet Teaching: Development and Usability Testing of an E-Learning Module," Pediatr. Diabetes, vol. 20, no. 3, pp. 293-303, 2019. DOI: 10.1111/pedi.12815.
[7] EdTech Talents Project Website. [Online]. Available: https://edtechtalents.eu. Accessed: Sep. 21, 2024.
[8] MatheArena Website. [Online]. Available: https://mathearena.com. Accessed: Sep. 21, 2024.
[9] C. Barnum, Usability Testing Essentials: Ready, Set...Test!, Elsevier, 2020. DOI: 10.1016/B978-0-12-416701-7.00001-1.
[10] C. K. Coursaris and D. J. Kim, "A Meta-Analytical Review of Empirical Mobile Usability Studies," J. Usability Stud., vol. 6, no. 3, pp. 117-171, 2011.
[11] S. Rakic, S. Softic, Y. Andriichenko, I. Turcin, B. Markoski, and J. Leoste, "Usability Platform Test: Evaluating the Effectiveness of Educational Technology Applications," in Proc. Int. Conf. Interactive Collaborative Learn ing (ICL), 2024.

[1] [1] P. Vlachogianni and N. Tselios, "Perceived Usability Evaluation of Educational Technology Using the Post-Study System Usability Questionnaire (PSSUQ): A Systematic Review," Sustainability, vol. 15, no. 17, pp. 1-15, 2023. DOI: 10.3390/su151712954.

[2] [2] M. F. Costabile, M. De Marsico, R. Lanzilotti, V. L. Plantamura, and T. Roselli, "On the Usability Evaluation of E-Learning Applications," in Proc. 38th Hawaii Int. Conf. System Sciences (HICSS), 2005, pp. 6b-6b. DOI: 10.1109/HICSS.2005.468.

[3] [3] V. Chang, "Review and Discussion: E-Learning for Academia and Industry," Int. J. Inf. Manage., vol. 36, no. 3, pp. 476-485, Jun. 2016. DOI: 10.1016/j.ijinfomgt.2015.12.007.

[4] [4] S. Criollo-C, A. Guerrero-Arias, Á. Jaramillo-Alcázar, and S. Luján-Mora, "Mobile Learning Technologies for Education: Benefits and Pending Issues," Appl. Sci., vol. 11, no. 9, pp. 4111-4123, May 2021. DOI: 10.3390/app11094111.

[5] [5] P. Bourges-Waldegg, L. Moreno, and T. Rojano, "The Role of Usability in the Implementation and Evaluation of Educational Technology," in Proc. 33rd Annu. Hawaii Int. Conf. System Sciences (HICSS), 2000, pp. 7-pp. DOI: 10.1109/HICSS.2000.926722.

[6] [6] G. Connan et al., "Online Education for Gluten-Free Diet Teaching: Development and Usability Testing of an E-Learning Module," Pediatr. Diabetes, vol. 20, no. 3, pp. 293-303, 2019. DOI: 10.1111/pedi.12815.

[7] [7] EdTech Talents Project Website. [Online]. Available: https://edtechtalents.eu. Accessed: Sep. 21, 2024.

[8] [8] MatheArena Website. [Online]. Available: https://mathearena.com. Accessed: Sep. 21, 2024.

[9] [9] C. Barnum, Usability Testing Essentials: Ready, Set...Test!, Elsevier, 2020. DOI: 10.1016/B978-0-12-416701-7.00001-1.

[10] [10] C. K. Coursaris and D. J. Kim, "A Meta-Analytical Review of Empirical Mobile Usability Studies," J. Usability Stud., vol. 6, no. 3, pp. 117-171, 2011.

[11] [11] S. Rakic, S. Softic, Y. Andriichenko, I. Turcin, B. Markoski, and J. Leoste, "Usability Platform Test: Evaluating the Effectiveness of Educational Technology Applications," in Proc. Int. Conf. Interactive Collaborative Learn ing (ICL), 2024.