Article Sidebar

Download
pdf
Statistic
Read Counter : 2 Download : 2

Downloads

Download data is not yet available.

Main Article Content

Abstract

Although LMS-based online assessment is widely used, there is a paucity of empirical research studies that have investigated its multidimensional validity from students’ perspectives, especially in Indonesian higher education. The proposed cross-sectional survey research examines students’ perceptions of the validity and quality of online assessment in the English Education Department at Universitas Halu Oleo (UHO) delivered through the E-Green SPADA (Moodle-based) course platform. The study conceptualizes perceived validity based on multidimensional and argument-based validity frameworks that are prominent in contemporary research. A 25-item questionnaire (5-point Likert scale) that included construct validity, assessment fairness, feedback & support, learning impact, and affective impact was administered to a stratified random sample of 120 students during the final week of the semester. Exploratory factor analysis showed a five-factor structure (KMO = 0.89; Bartlett χ²(300) = 1650.3, p < .001), which explained 68.2% of the total variance, with acceptable internal consistency (α = .76–.89). The descriptive results showed that construct validity (M = 4.21, SD = 0.61) and assessment fairness (M = 4.08, SD = 0.65) were highly rated, while feedback & support received relatively low scores (M = 3.49, SD = .79). Feedback & support was the strongest predictor of overall perceived validity (β = .458, p < .001) in multiple regression analysis, and the full model accounted for 62.7% of the variance (R² = .627). These findings provide support for the consequential facet of validity in that the prompt, comprehensive, and accessible feedback can influence students’ confidence in online assessment. The research adds evidence from the Indonesian EFL higher education context and highlights the importance of LMS design features, instructor training, and feedback literacy programs that facilitate dialogic and responsive feedback practices.

Keywords

Online Assessment Validity; Student Perceptions; Feedback And Auspport; Learning Management System; Exploratory Factor Analysis

Article Details

Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.

Author Biography

Mursalim, Universitas Halu Oleo

Lecturer at Jurusan Pendidikan Bahasa Inggris, FKIP, UHO

How to Cite
Mursalim, Alberth, Nggawu, L. O., Ayu, A. P., & Wahyudin Madil. (2026). Feedback as a Determinant of Online Assessment Validity: A Multidimensional Analysis in Indonesian EFL Higher Education. Eduvelop: Journal of English Education and Development , 9(1), 241-252. https://doi.org/10.31605/eduvelop.v9i1.6093

References

  1. Almulla, M. (2020). Developing 21st-century competencies through project-based learning. International Journal of Instruction, 13(1), 233–248.
  2. Al-Tamimi, A., & Lin, S. (2018). Speaking anxiety among university students and its impact on performance. International Journal of Education and Literacy Studies, 6(1), 39–48.
  3. Alqurashi, E. (2022). What do students engage with the most? A comparative study between high- and low-achieving students within online learning environments. Open Learn.37, 219–234. doi: 10.1080/02680513.2020.1758052
  4. Ambawani, S., Astasari, I., & Rukiati, E. (2025). Overcoming barriers to EFL speaking proficiency: A multidimensional analysis of language learning challenges. Journal of English in Academic and Professional Communication (JEAPCO), 11(1), 2025. https://doi.org/10.25047/jeapco.v11i1.5769
  5. Aubrey S. (2022). Enhancing long-term learner engagement through project-based learning
  6. Bell, S. (2015). PJBL as a tool for deeper learning in the 21st century. The Clearing House, 83(2), 39–43.
  7. Birdman J., Wiek A., Lang D. J. (2022). Developing key competencies in sustainability through project-based learning in graduate sustainability programs. Int. J. Sustain. High. Educ. 23, 1139–1157. 10.1108/IJSHE-12-2020-0506
  8. Blumenfeld P. C., Soloway E., Marx R. W., Krajcik J. S., Guzdial M., Palincsar A. (1991). Motivating project-based learning: sustaining the doing, supporting the learning. Educ. Psychol. 26, 369–398. 10.1080/00461520. 1991.9653139
  9. Camacho-Morles, J., Slemp, G. R., Pekrun, R., Loderer, K., Hou, H., & Oades, L. G. (2021). Activity achievement, emotions, and academic performance: A meta-analysis. Educational psychology review, 33(3), 1051-1095.
  10. Creswell, J. W., & Poth, C. N. (2018). Qualitative inquiry and research design: Choosing among five approaches (4th ed.). SAGE Publications.
  11. Derakhshan, A., & Karimian, Z. (2021). Exploring the relationship between speaking skills and academic performance. Language Teaching Research Quarterly, 21, 45–59.
  12. Dehbozorgi, N. & Kunuku, M. T. (2023). Exploring the influence of emotional states in peer interactions on students’ academic performance. IEEE Trans. Educ.67, 405–412. doi: 10.1109/te.2023.3335171
  13. Dewaele, J.-M., & Li, C. (2020). Emotions in second language acquisition: A critical review and research agenda. Foreign Language Annals, 53(2), 343–362.
  14. Du X., Lundberg A., Ayari M. A., Naji K. K., Hawari A. (2022). Examining engineering students' perceptions of learner agency enactment in problem- and project-based learning using Q methodology. J. Eng. Educ. 111, 111–136. 10.1002/jee.20430
  15. Elov, B., Abdullayeva, I., Raupova, L., Kholikov, A., & Mirkasimova, M. (2025). Speaking exams with less anxiety in Intelligent Computer-Assisted Language Assessment (ICALA): mirroring EFL learners’ foreign language anxiety, shyness, autonomy, and enjoyment. Language Testing in Asia, 15(1), 3.
  16. Ferecbeyli, N. (2025). Project-Based Learning in Language Teaching. EuroGlobal Journal of Linguistics and Language Education, 2(5), 107–118. https://doi.org/10.69760/egjlle.2505009
  17. Ferrero, M., Vadillo, M. A., & León, S. P. (2021). Is project-based learning effective among kindergarten and elementary students? A systematic review. PLoS One, 16(4), e0249627.
  18. Gabuardi V. M. F. (2021). Project-based learning: Boosting 21st-century skills. Revista Estudios, 43, 340–419. doi: 10.15517/re.v0i43.49335
  19. Gökçen, A., & Güngör, S. (2023). How project-based learning promotes emotional involvement in university students. Journal of Language and Education, 9(2), 22–30.
  20. Habbal F., Kolmos A., Hadgraft R. G., Holgaard J. E., Reda K. (2024). “Problem and project-based learning at aalborg,” in Reshaping Engineering Education (Springer Nature Singapore), 199–222
  21. Hadibarata, T., Hidayat, T., & Kwabena, J. (2023). Problem-based learning in engineering courses in Malaysia. Acta Pedagogia Asiana, 2(2), 95-105.
  22. Hidayati, D., Novianti, H., Khansa, M., Slamet, J., & Suryati, N. (2023). Effectiveness of project-based learning in ESP class: Viewed from Indonesian students’ learning outcomes. International Journal of Information and Education Technology, 13(3), 558-565.
  23. Huang, L., & Liu, M. (2025) The impact of technology on foreign language anxiety: A systematic review of empirical studies from 2004 to 2024. Humanit Soc Sci Commun 12, 1665. https://doi.org/10.1057/s41599-025-05921-6
  24. Kim, Y. (2019). Emotional engagement in ESL speaking through project-based tasks. Asian EFL Journal, 21(3), 156–175.
  25. Lestari, R. D., Syahid, A., & Widiastuty, H. (2025). Strategies for Managing EFL Speaking Anxiety in an Indonesian University: A Sequential Explanatory Study. https://doi.org/10.25217/jed.v3i01.5645
  26. María, V., & Gabuardi, F. (n.d.). Project-Based Learning: Boosting 21st Century Skills. Revista Estudios, 43, 2021. Retrieved https://orcid.org/0000-0002-8401-122X
  27. Menon, M. E., Markadjis, E., Theodoropoulos, N., & Socratous, M. (2017). Higher education choices: What drives students' decisions? Studies in Higher Education, 42(2), 252–267.
  28. Merriam, S. B., & Tisdell, E. J. (2016). Qualitative research: A guide to design and implementation (4th ed.). Jossey-Bass.
  29. Meyer, D. K., & Turner, J. C. (2019). Emotional engagement and motivation to learn: A review of current research. Educational Psychology Review, 31(2), 399–419.
  30. Mims, C. (2020). Meaningful learning and student participation in higher education. Journal of Instructional Pedagogies, 25, 112–126.
  31. Mota, F. B., Cabral, B. P., Braga, L. A. M., & Lopes, R. M. (2025). Mapping the global research on project-based learning: a bibliometric and network analysis (2014–2024). In Frontiers in Education (Vol. 10). Frontiers Media SA. https://doi.org/10.3389/feduc.2025.1522694
  32. Nifriza, I., Rahmalia, I., & Reswary, D. A. (2025). The Effect of Project-based Learning on the Improvement of Listening Skills in Junior High School Students. Linguistic, English Education and Art (LEEA) Journal, 8(3), 305–310. https://doi.org/10.31539/zrmxnw51
  33. Nurmala, I., Bukhari, D., & Habibi, M. A. (2021). Project-Based Learning (PJBL) to Improve Students' Speaking Skills in EFL Classrooms. Journal of Language Teaching and Research, 12(4), 682–688. https://doi.org/10.17507/jltr.1204.06.
  34. Pekrun, R., Goetz, T., & Perry, R. P. (2017). Understanding learners’ emotions through control-value theory. In R. Pekrun & L. Linnenbrink-Garcia (Eds.), Handbook of emotions in education (2nd ed., pp. 120–141). Routledge.
  35. Rusyda, R. N., & Riyanto, S. (2023). Enhancing EFL Students’ Speaking Performance through Digital Project-Based Learning. Journal of English Language Education and Literature, 7(1), 45–58. https://doi.org/10.31227/osf.io/3h2xf.
  36. Sa’adah, H., & Wahyuni, S. (2024). A critical review: Students’ outcomes of project-based learning (PjBL). Prominent: Journal of English Studies, 7(2), 1-15.
  37. Sari, F. M., & Oktaviani, L. (2020). The Use of Project-Based Learning in Improving Students’ Speaking Ability and Creativity. Journal of English Language Teaching and Linguistics, 5(3), 349–359. https://doi.org/10.21462/jeltl.v5i3.418.
  38. Siahaan, B. L., & Siahaan, M. M. (2023). The Implementation of Project-Based Learning Connected with Digital Technology to Increase Students' Speaking Competence of Madrasah Aliyah Negeri (MAN) Simalungun Regency. AL-ISHLAH: Jurnal Pendidikan, 15(1), 497–506. https://doi.org/10.35445/alishlah.v15i1.2580
  39. Solhi, M. (2024). The impact of EFL learners’ negative emotional orientations on (un)willingness to communicate in in-person and online L2 learning contexts. Journal of Psycholinguistic Research, 53(2), 26.
  40. Thomas, J. W. (2020). A review of research on project-based learning. Buck Institute for Education.
  41. Thomas, N. J., Baral, R. (2023). Mechanism of gamification: Role of flow in the behavioral and emotional pathways of engagement in management education. The International Journal of Management Education, 21, 1, https://doi.org/10.1016/j.ijme.2022.100718.
  42. Tran, N., Hoang, D. T. N., Gillespie, R., Yen, T. T. H., & Phung, H. (2024). Enhancing EFL learners’ speaking and listening skills through authentic online conversations with video conferencing tools. Innovation in Language Learning and Teaching, 1-11.
  43. Wijaya, A. N., Al Faruq Hasyim, U. A., Zuniati, M., & Khatan Smita, M. (2025). The Effectiveness of Project-Based Learning Toward Students’ Speaking Performance and Skill. Attractive: Innovative Education Journal, 8(1). https://www.attractivejournal.com/index.php/aj/
  44. Zein, S., Sukyadi, D., Hamied, F. A., & Lengkanawati, N. S. (2020). English language education in Indonesia: A review of research (2011–2019). Language Teaching, 53(4), 491-523.
  45. Zhong, J., Ismail, L., & Lin, Y. (2025). Investigating EFL students’ engagement in project-based speaking activities: from a multi-dimensional perspective. Frontiers in Psychology, 16. https://doi.org/10.3389/fpsyg.2025.1598513