The geographic inquiry process skills scale: A validation study

Bagila Sadykova; Ulzhalgas Yesnazarova; Aigul Tokbergenova

doi:10.29333/ejmste/13471

Full Text (PDF)

Bagila Sadykova ¹ ^* , Ulzhalgas Yesnazarova ¹ , Aigul Tokbergenova ¹

More Detail

¹ Department of Geography, Land Management, and Cadastre, Al-Farabi Kazakh National University, Almaty, KAZAKHSTAN^* Corresponding Author

Abstract

Geographic inquiry has immense potential to spark the interest of school students in science and societal issues, such as climate change or resource scarcity. However, implementing inquiry-based learning in secondary school contexts is frequently seen as a challenge. So far, standardized geography assessments have primarily focused on students’ spatial-thinking abilities, and there is a dearth of practicable tools to measure their inquiry skills. This study aimed to translate the self-report geographic inquiry process skills scale into Kazakh and test its reliability and validity among Kazakhstani secondary students. A total of 826 secondary school students aged between 13 and 18 were included in the analysis. Both exploratory and confirmatory factor analyses jointly supported a five-dimensional structure of the questionnaire. The scale exhibited sound measurement properties, including consistency over a two-week test-retest interval. The scores for the adapted instrument were not significantly correlated with participant gender, grade, age, or time spent preparing for the cross-national geography assessment. Proposals for future research are outlined.

Keywords

geography
Kazakhstan
scale adaptation
secondary school
secondary students

License

This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Article Type: Research Article

EURASIA J Math Sci Tech Ed, 2023, Volume 19, Issue 9, Article No: em2319

https://doi.org/10.29333/ejmste/13471

Publication date: 01 Sep 2023

Online publication date: 09 Jul 2023

Article Views: 1101

Article Downloads: 655

Open Access References How to cite this article

References

Al Mamun, M. A., Lawrie, G., & Wright, T. (2022). Exploration of learner-content interactions and learning approaches: The role of guided inquiry in the self-directed online environments. Computers & Education, 178, 104398. https://doi.org/10.1016/j.compedu.2021.104398
Aldahmash, A. H., & Omar, S. H. (2021). Analysis of activities included in Saudi Arabian chemistry textbooks for the inclusion of argumentation-driven inquiry skills. Studies in Educational Evaluation, 68, 68100968. https://doi.org/10.1016/j.stueduc.2020.100968
Avelino, P. R., Nascimento, L. R., Menezes, K. K., Alvarenga, M. T. M., Fortini, I. F., & Teixeira-Salmela, L. F. (2022). Test-retest reliability and measurement error of the modified gait efficacy scale in individuals with stroke. Physiotherapy Theory and Practice, 38(13), 1-6. https://doi.org/10.1080/09593985.2021.1952669
Bandura, A. (1997). Self-efficacy: The exercise of control. W.H. Freeman and Company.
Baum, E. J. (2013). Augmenting guided-inquiry learning with a blended classroom approach. Journal of College Science Teaching, 42(6), 27-33. https://doi.org/10.2505/4/jcst13_042_06_27
Bhat, N. A., Devdutt, J., Johnson, J. A., & Roopesh, B. N. (2021). Adaptation and psychometric validation of Hindi version of the behavioral emotion regulation questionnaire. Asian Journal of Psychiatry, 62, 102730. https://doi.org/10.1016/j.ajp.2021.102730
Bidell, T. R., & Fischer, K. W. (1992). Beyond the stage debate: Action, structure, and variability in Piagetian theory and research. In R. J. Sternberg, & C. A. Berg (Eds.), Intellectual development. Cambridge University Press.
Brenner, P. S., & DeLamater, J. (2016). Lies, damned lies, and survey self-reports? Identity as a cause of measurement bias. Social Psychology Quarterly, 79(4), 333-354. https://doi.org/10.1177/0190272516628298
Curtis, M. D. (2019). Professional technologies in schools: The role of pedagogical knowledge in teaching with geospatial technologies. Journal of Geography, 118(3), 130-142. https://doi.org/10.1080/00221341.2018.1544267
Darmuki, A., Nugrahani, F., Fathurohman, I., Kanzunnudin, M., & Hidayati, N. A. (2023). The impact of inquiry collaboration project based learning model of Indonesian language course achievement. International Journal of Instruction, 16(2), 247-266. https://doi.org/10.29333/iji.2023.16215a
De La Torre, S., Spruijt-Metz, D., & Farias, A. J. (2022). Survivors’ health competence mediates the association between wearable activity tracker use and self-rated health: HINTS analysis. Journal of Cancer Survivorship, 16(6), 1268-1278. https://doi.org/10.1007/s11764-021-01112-9
Dilbaz, N., Noyan, O., Alpar, G., & Kazan, O. (2020). Development of the COVID-19 phobia scale: Validity and reliability study. The Journal of Neurobehavioral Sciences, 7(3), 142-151. https://doi.org/10.4103/jnbs.jnbs_27_20
Ding, X., & Vancleef, K. (2022). Test-retest reliability and practice effect of the Leuven perceptual organization screening test. Behavior Research Methods, 54(5), 2457-2462. https://doi.org/10.3758/s13428-021-01741-z
Eze, E. (2021). Why secondary school geography students perform poorly in external examinations. Journal of Geography, 120(2), 51-60. https://doi.org/10.1080/00221341.2020.1860114
Feyzioglu, B. (2019). The role of inquiry-based self-efficacy, achievement goal orientation, and learning strategies on secondary-school students’ inquiry skills. Research in Science & Technological Education, 37(3), 366-392. https://doi.org/10.1080/02635143.2019.1579187
Furtak, E. M., Seidel, T., Iverson, H., & Briggs, D. C. (2012). Experimental and quasi-experimental studies of inquiry-based science teaching. Review of Educational Research, 82(3), 300-329. https://doi.org/10.3102/0034654312457206
Ganajova, M., Sotakova, I., Lukač, S., Jeskova, Z., Jurkova, V., & Orosova, R. (2021). Formative assessment as a tool to enhance the development of inquiry skills in science education. Journal of Baltic Science Education, 20(2), 204-222. https://doi.org/10.33225/jbse/21.20.204
Gao, Y., Dai, H., Jia, G., Liang, C., Tong, T., Zhang, Z., Song, R., Wang, Q., & Zhu, Y. (2020). Translation of the Chinese version of the nomophobia questionnaire and its validation among college students: Factor analysis. JMIR MHealth and UHealth, 8(3), e13561. https://doi.org/10.2196/13561
Gillon, K., & Stotter, J. (2011). Inquiry learning with senior secondary students: Yes it can be done! Access, 25(3), 14-19. https://doi.org/10.29173/iasl7744
Gonzalez, R. D. M., & Torres, M. L. D. L. (2020). WebGIS implementation and effectiveness in secondary education using the digital atlas for schools. Journal of Geography, 119(2), 74-85. https://doi.org/10.1080/00221341.2020.1726991
Harte, W., & Reitano, P. (2016). “Doing geography”: Evaluating an independent geographic inquiry assessment task in an initial teacher education program. Journal of Geography, 115(6), 233-243. https://doi.org/10.1080/00221341.2016.1175496
Heindl, M. (2019). Inquiry-based learning and the pre-requisite for its use in science at school: A meta-analysis. Journal of Pedagogical Research, 3(2), 52-61. https://doi.org/10.33902/jpr.2019254160
Hohnle, S., Fögele, J., Mehren, R., & Schubert, J. C. (2015). GIS teacher training: Empirically-based indicators of effectiveness. Journal of Geography, 115(1), 12-23. https://doi.org/10.1080/00221341.2015.1016546
Hussien, S., Wahab, A. M. K., & Hashim, R. (2021). Improving students’ inquiry skills in Islamic education through hikmah pedagogy and community of inquiry. Malaysian Journal of Learning and Instruction, 18(2), 189-214. https://doi.org/10.32890/mjli2021.18.2.7
Jant, E. A., Uttal, D. H., Kolvoord, R., James, K., & Msall, C. (2019). Defining and measuring the influences of GIS-based instruction on students’ STEM-relevant reasoning. Journal of Geography, 119(1), 22-31. https://doi.org/10.1080/00221341.2019.1676819
Jesková, Z., Balogova, B., & Kires, M. (2018). Assessing inquiry skills of upper secondary school students. Journal of Physics: Conference Series, 1076, 012022. https://doi.org/10.1088/1742-6596/1076/1/012022
Jeskova, Z., Lukač, S., Snajder, U., Gunis, J., Klein, D., & Kires, M. (2022). Active learning in STEM education with regard to the development of inquiry skills. Education Sciences, 12(10), 686. https://doi.org/10.3390/educsci12100686
Jorgensen, J. E., Fearon, A. M., Molgaard, C. M., Kristinsson, J., & Andreasen, J. (2020). Translation, validation and test-retest reliability of the VISA-G patient-reported outcome tool into Danish (VISA-G.DK). PeerJ, 8, e8724. https://doi.org/10.7717/peerj.8724
Kachergis, G., Rhodes, M., & Gureckis, T. (2017). Desirable difficulties during the development of active inquiry skills. Cognition, 166, 407-417. https://doi.org/10.1016/j.cognition.2017.05.021
Kanbay, Y., Firat, M., Akcam, A., Cinar, S., & Ozbay, Z. (2021). Development of Firat netlessphobia scale and investigation of its psychometric properties. Perspectives in Psychiatric Care, 58(4), 1258-1266. https://doi.org/10.1111/ppc.12924
Kapici, H.O., Akcay, H., & de Jong, T. (2019). Using hands-on and virtual laboratories alone or together–which works better for acquiring knowledge and skills? Journal of Science Education and Technology, 28, 231-250. https://doi.org/10.1007/s10956-018-9762-0
Keefer, A., Singh, V., Kalb, L. G., Mazefsky, C. A., & Vasa, R. A. (2019). Investigating the factor structure of the child behavior checklist dysregulation profile in children and adolescents with autism spectrum disorder. Autism Research, 13(3), 436-443. https://doi.org/10.1002/aur.2233
Khalaf, B. K., & Zin, Z. B. M. (2018). Traditional and inquiry-based learning pedagogy: A systematic critical review. International Journal of Instruction, 11(4), 545-564. https://doi.org/10.12973/iji.2018.11434a
Kim, M., & Bednarz, R. (2013). Effects of a GIS course on self-assessment of spatial habits of mind (SHOM). Journal of Geography, 112(4), 165-177. https://doi.org/10.1080/00221341.2012.684356
Klahr, D., & Dunbar, K. (1988). Dual space search during scientific reasoning. Cognitive Science, 12(1), 1-48. https://doi.org/10.1207/s15516709cog1201_1
Koo, T. K., & Li, M. Y. (2016). A guideline of selecting and reporting intraclass correlation coefficients for reliability research. Journal of Chiropractic Medicine, 15(2), 155-163. https://doi.org/10.1016/j.jcm.2016.02.012
Kremer, K., Specht, C., Urhahne, D., & Mayer, J. (2013). The relationship in biology between the nature of science and scientific inquiry. Journal of Biological Education, 48(1), 1-8. https://doi.org/10.1080/00219266.2013.788541
Kuang, X., Eysink, T. H. S., & de Jong, T. (2022). Effects of providing domain information on facilitating hypothesis generation in inquiry learning. The Journal of Educational Research, 115(5), 285-297. https://doi.org/10.1080/00220671.2022.2124219
Kuhn, D., & Pease, M. (2008). What needs to develop in the development of inquiry skills? Cognition and Instruction, 26(4), 512-559. https://doi.org/10.1080/07370000802391745
Lam, E. T. C., Zhang, J. J., & Jensen, B. E. (2005). Service quality assessment scale (SQAS): An instrument for evaluating service quality of health-fitness clubs. Measurement in Physical Education and Exercise Science, 9(2), 79-111. https://doi.org/10.1207/s15327841mpee0902_2
Lane, R., & Bourke, T. (2017). Assessment in geography education: A systematic review. International Research in Geographical and Environmental Education, 28(1), 22-36. https://doi.org/10.1080/10382046.2017.1385348
Lazonder, A. W., & Harmsen, R. (2016). Meta-analysis of inquiry-based learning. Review of Educational Research, 86(3), 681-718. https://doi.org/10.3102/0034654315627366
Lehtinen, A., Nieminen, P., Pehkonen, S., & Hahkiöniemi, M. (2022). Comparing guidance via implicit and explicit model progressions in a collaborative inquiry-based learning environment with different-aged learners. Education Sciences, 12(6), 393. https://doi.org/10.3390/educsci12060393
Machado, P. P., Grilo, C. M., Rodrigues, T. F., Vaz, A. R., & Crosby, R. D. (2020). Eating disorder examination–questionnaire short forms: A comparison. International Journal of Eating Disorders, 53(6), 937-944. https://doi.org/10.1002/eat.23275
Madan, D. B., & Wang, K. (2021). Option implied vix, skew and kurtosis term structures. International Journal of Theoretical and Applied Finance, 24(5), 2150030. https://doi.org/10.1142/s0219024921500308
Maddox, L. E., Howell, J. B., & Saye, J. W. (2018). Designing geographic inquiry: Preparing secondary students for citizenship. Journal of Geography, 117(6), 254-268. https://doi.org/10.1080/00221341.2018.1495249
Marcello, J. S. (2009). A proposal for assessment in geography education. Journal of Geography, 108(4-5), 226-232. https://doi.org/10.1080/00221340902946006
Metoyer, S., & Bednarz, R. (2016). Spatial thinking assists geographic thinking: Evidence from a study exploring the effects of geospatial technology. Journal of Geography, 116(1), 20-33. https://doi.org/10.1080/00221341.2016.1175495
Moreno, A., & Bartolome, E. (2021). Study and research paths to improve web-based inquiry learning: Study case of an ICT course in engineering. Education Sciences, 11(12), 772. https://doi.org/10.3390/educsci11120772
Nehring, A., Nowak, K. H., Belzen, A. U., & Tiemann, R. (2015). Predicting students’ skills in the context of scientific inquiry with cognitive, motivational, and sociodemographic variables. International Journal of Science Education, 37(9), 1343-1363. https://doi.org/10.1080/09500693.2015.1035358
Oberle, A. (2020). Advancing students’ abilities through the geo-inquiry process. Journal of Geography, 119(2), 43-54. https://doi.org/10.1080/00221341.2019.1698641
Oda, K., Herman, T., & Hasan, A. (2019). Properties and impacts of TPACK-based GIS professional development for in-service teachers. International Research in Geographical and Environmental Education, 29(1), 40-54. https://doi.org/10.1080/10382046.2019.1657675
Osborne, Z. M., van de Gevel, S. L., Eck, M. A., & Sugg, M. (2019). An assessment of geospatial technology integration in K–12 education. Journal of Geography, 119(1), 12-21. https://doi.org/10.1080/00221341.2019.1640271
Ozturk, B., Kaya, M., & Demir, M. (2022). Does inquiry-based learning model improve learning outcomes? A second-order meta-analysis. Journal of Pedagogical Research, 6(4), 201-216. https://doi.org/10.33902/jpr.202217481
Ozudogru, Y. H., & Demiralp, N. (2022). Developing a geographic inquiry process skills scale. Education Inquiry, 13(3), 374-394. https://doi.org/10.1080/20004508.2020.1864883
Padron, A., Galán, I., Durban, M., Gandarillas, A., & Rodriguez-Artalejo, F. (2012). Confirmatory factor analysis of the general health questionnaire (GHQ-12) in Spanish adolescents. Quality of Life Research, 21(7), 1291-1298. https://doi.org/10.1007/s11136-011-0038-x
Panaretos, D., Tzavelas, G., Vamvakari, M., & Panagiotakos, D. (2019). Investigating the role of orthogonal and non–orthogonal rotation in multivariate factor analysis, in regard to the repeatability of the extracted factors: A simulation study. Communications in Statistics–Simulation and Computation, 48(7), 2165-2176. https://doi.org/10.1080/03610918.2018.1435803
Pedaste, M., & Altin, H. (2020). Does inquiry-based education using robots have an effect on learners’ inquiry skills, subject knowledge and skills, and motivation? International Journal on Advanced Science, Engineering and Information Technology, 10(4), 1403. https://doi.org/10.18517/ijaseit.10.4.12766
Pedaste, M., Maeots, M., Leijen, A., & Sarapuu, T. (2012). Improving students’ inquiry skills through reflection and self-regulation scaffolds. Technology, Instruction, Cognition and Learning, 9(1-2), 81-95.
Perugini, S., & Bodzin, A. M. (2020). Using web-based GIS to assess students’ geospatial knowledge of hurricanes and spatial habits of mind. Journal of Geography, 119(2), 63-73. https://doi.org/10.1080/00221341.2019.1710764
Petermann, V., & Vorholzer, A. (2022). Relationship between beliefs of teachers about and their use of explicit instruction when fostering students’ scientific inquiry competencies. Education Sciences, 12(9), 593. https://doi.org/10.3390/educsci12090593
Petridou, E., Molohidis, A., & Hatzikraniotis, E. (2022). Assessing students’ ability to apply the control of variables strategy when engaged with inquiry-based worksheets during the COVID-19 era. Education Sciences, 12(10), 668. https://doi.org/10.3390/educsci12100668
Preskill, H., & Torres, R. T. (1999). Building capacity for organizational learning through evaluative inquiry. Evaluation, 5(1), 42-60. https://doi.org/10.1177/135638909900500104
Quinn, S., Hogan, M., Dwyer, C., Finn, P., & Fogarty, E. (2020). Development and validation of the student-educator negotiated critical thinking dispositions scale (SENCTDS). Thinking Skills and Creativity, 38, 100710. https://doi.org/10.1016/j.tsc.2020.100710
Rafiq, A. A., Triyono, M. B., & Djatmiko, I. W. (2023). The integration of inquiry and problem-based learning and its impact on increasing the vocational student involvement. International Journal of Instruction, 16(1), 659-684. https://doi.org/10.29333/iji.2023.16137a
Sakaluk, J. K., & Short, S. D. (2016). A methodological review of exploratory factor analysis in sexuality research: Used practices, best practices, and data analysis resources. The Journal of Sex Research, 54(1), 1-9. https://doi.org/10.1080/00224499.2015.1137538
Sarstedt, M., & Mooi, E. (2014). A concise guide to market research: The process, data, and methods using IBM SPSS statistics. Springer. https://doi.org/10.1007/978-3-642-53965-7_8
Schlemper, M. B., Athreya, B., Czajkowski, K., Stewart, V. C., & Shetty, S. (2018). Teaching spatial thinking and geospatial technologies through citizen mapping and problem-based inquiry in grades 7-12. Journal of Geography, 118(1), 21-34. https://doi.org/10.1080/00221341.2018.1501083
Schultz, R. B., & DeMers, M. N. (2020). Transitioning from emergency remote learning to deep online learning experiences in geography education. Journal of Geography, 119(5), 142-146. https://doi.org/10.1080/00221341.2020.1813791
Senisum, M., Susilo, H., Suwono, H., & Ibrohim, N. F. (2022). GIReSiMCo: A learning model to scaffold students’ science process skills and biology cognitive learning outcomes. Education Sciences, 12(4), 228. https://doi.org/10.3390/educsci12040228
Seow, T., Chang, J., & Irvine, K. N. (2019). Field-based inquiry as a signature pedagogy for geography in Singapore. Journal of Geography, 118(6), 227-237. https://doi.org/10.1080/00221341.2018.1561740
Soares, J., Taveira, M. D. C., Barroso, P., & Silva, A. D. (2022). Career adapt-abilities scale-short form: Validation among Portuguese university students and workers. Journal of Career Assessment. https://doi.org/10.1177/10690727221129281
Solem, M., Vaughan, P., Savage, C., & De Nadai, A. S. (2021). Student- and school-level predictors of geography achievement in the United States, 1994-2018. Journal of Geography, 120(6), 201-211. https://doi.org/10.1080/00221341.2021.2000009
Spires, H. A., Himes, M. P., & Krupa, E. (2022). Supporting students’ science content knowledge and motivation through project-based inquiry (PBI) global in a cross-school collaboration. Education Sciences, 12(6), 412. https://doi.org/10.3390/educsci12060412
Tak, C. C., Zulnaidi, H., & Eu, L. K. (2022). Measurement model testing: Adaption of self-efficacy and metacognitive awareness among university students. EURASIA Journal of Mathematics, Science and Technology Education, 18(9), em2153. https://doi.org/10.29333/ejmste/12366
Timms, M. J., Moyle, K., Weldon, P. R., & Mitchell, P. (2018). Challenges in STEM learning in Australian schools: Literature and policy review. Australian Council for Educational Research. https://research.acer.edu.au/policy_analysis_misc/28
Towne, F. S. (2009). Is adolescence a critical period for learning formal thinking skills? A case study investigating the development of formal thinking skills in a short-term inquiry-based intervention program [PhD dissertation, University of Montana].
Turner, R. C., & Carlson, L. (2003). Indexes of item-objective congruence for multidimensional items. International Journal of Testing, 3(2), 163-171. https://doi.org/10.1207/S15327574IJT0302_5
Vaz, S., Falkmer, T., Passmore, A. E., Parsons, R., & Andreou, P. (2013). The case for using the repeatability coefficient when calculating test-retest reliability. PLoS ONE, 8(9), e73990. https://doi.org/10.1371/journal.pone.0073990
Wan Hassan, W. N., Yusof, Z. Y. M., Shahidan, S. S. Z., Mohd Ali, S. F., & Makhbul, M. Z. M. (2017). Validation and reliability of the translated Malay version of the psychosocial impact of dental aesthetics questionnaire for adolescents. Health and Quality of Life Outcomes, 15, 1. https://doi.org/10.1186/s12955-017-0600-5
Wang, J., Guo, D., & Jou, M. (2015). A study on the effects of model-based inquiry pedagogy on students’ inquiry skills in a virtual physics lab. Computers in Human Behavior, 49, 658-669. https://doi.org/10.1016/j.chb.2015.01.043
Wilson, C. D., Taylor, J. A., Kowalski, S. M., & Carlson, J. (2009). The relative effects and equity of inquiry-based and commonplace science teaching on students’ knowledge, reasoning, and argumentation. Journal of Research in Science Teaching, 47(3), 276-301. https://doi.org/10.1002/tea.20329
Wu, H., & Hsieh, C. (2006). Developing sixth graders’ inquiry skills to construct explanations in inquiry‐based learning environments. International Journal of Science Education, 28(11), 1289-1313. https://doi.org/10.1080/09500690600621035
Xuan, X., Jin, Q., Jo, I., Duan, Y., & Kim, M. (2019). The potential contribution of geography curriculum to scientific literacy. Journal of Geography, 118(5), 185-196. https://doi.org/10.1080/00221341.2019.1611906
Zhdanov, S. P., Ishmuradova, A. M., Zakharova, V. L., Belous, S. V., & Grishnova, E. E. (2022). Validation and adaptation of the questionnaire on science motivation in the Russian context. EURASIA Journal of Mathematics, Science and Technology Education, 18(8), em2136. https://doi.org/10.29333/ejmste/12219
Zijlmans, E. A. O., Tijmstra, J., van der Ark, L. A., & Sijtsma, K. (2019). Item-score reliability as a selection tool in test construction. Frontiers in Psychology, 9, 2298. https://doi.org/10.3389/fpsyg.2018.02298

How to cite this article

APA

Sadykova, B., Yesnazarova, U., & Tokbergenova, A. (2023). The geographic inquiry process skills scale: A validation study. Eurasia Journal of Mathematics, Science and Technology Education, 19(9), em2319. https://doi.org/10.29333/ejmste/13471

Vancouver

Sadykova B, Yesnazarova U, Tokbergenova A. The geographic inquiry process skills scale: A validation study. EURASIA J Math Sci Tech Ed. 2023;19(9):em2319. https://doi.org/10.29333/ejmste/13471

AMA

Sadykova B, Yesnazarova U, Tokbergenova A. The geographic inquiry process skills scale: A validation study. EURASIA J Math Sci Tech Ed. 2023;19(9), em2319. https://doi.org/10.29333/ejmste/13471

Chicago

Sadykova, Bagila, Ulzhalgas Yesnazarova, and Aigul Tokbergenova. "The geographic inquiry process skills scale: A validation study". Eurasia Journal of Mathematics, Science and Technology Education 2023 19 no. 9 (2023): em2319. https://doi.org/10.29333/ejmste/13471

Harvard

Sadykova, B., Yesnazarova, U., and Tokbergenova, A. (2023). The geographic inquiry process skills scale: A validation study. Eurasia Journal of Mathematics, Science and Technology Education, 19(9), em2319. https://doi.org/10.29333/ejmste/13471

MLA

Sadykova, Bagila et al. "The geographic inquiry process skills scale: A validation study". Eurasia Journal of Mathematics, Science and Technology Education, vol. 19, no. 9, 2023, em2319. https://doi.org/10.29333/ejmste/13471