A Comprehensive Evaluation of Machine Learning Techniques for Forecasting Student Academic Success
Abstract
Improving academic outcomes relies on accurately anticipating student outcomes within a course or program. This predictive capability empowers instructional leaders to optimize the allocation of resources and tailor instruction to meet individual student needs more effectively. In this study, we endeavor to delineate the attributes of machine learning algorithms that excel in forecasting student grades. Leveraging a comprehensive dataset encompassing both personal student information and corresponding grades, we embark on a rigorous evaluation of various regression algorithms. Our analysis encompasses a range of widely used technniques, Incorporating various machine learning algorithms like XGBoost, Linear Regression, K-Nearest Neighbor, Decision Tree, Random Forest, and Deep Neural Network. By conducting thorough comparisons using metrics such as Root Mean Squared Error, determination coefficient, Mean Average Error and Mean Squared Error. Our aim is to pinpoint the algorithm that exhibits superior predictive ability. Notably, our experimental findings unveil the deep neural network as the standout performer among the evaluated algorithms. Having an outstanding coefficient of determination of 99.95% and Minimal error margins, the DNN emerges as a potent tool for accurately forecasting student grades. This discovery not only underscores the efficacy of advanced machine learning methodologies but also underscores the transformative potential they hold in shaping educational practices and optimizing student outcomes.
Downloads
References
Chen, S., Ding, Y.: A machine learning approach to predicting academic performance in pennsylvania’s schools. Social Sciences 12(3), 118 (2023)
Bertolini, R., Finch, S.J., Nehm, R.H.: Quantifying variability in predictions of student performance: Examining the impact of bootstrap resampling in data pipelines. Computers and Education: Artificial Intelligence 3, 100067 (2022)
Subbarayudu, Y., Reddy, G.V., Kumar, M.R., Nai, M.A., Prashanthi, G., Bhalla, L.: Predicting students’ failure risk education through machine learning. In: MATEC Web of Conferences, vol. 392, p. 01113 (2024). EDP Sciences.
Pelima, L.R., Sukmana, Y., Rosmansyah, Y.: Predicting university student graduation using academic performance and machine learning: A systematic literature review. IEEE Access (2024).
Kapucu, M.S., O ̈zcan, H., Aypay, A., et al.: Predicting secondary school students’ academic performance in science course by machine learning. International Journal of Technology in Education and Science 8(1), 41–62 (2024)
Sandra, L., Lumbangaol, F., Matsuo, T.: Machine learning algorithm to predict student’s performance: A systematic literature review. TEM Journal 10(4) (2021)
Yang, X., Zhang, H., Chen, R., Li, S., Zhang, N., Wang, B., Wang, X., et al.: Research on forecasting of student grade based on adaptive k-means and deep neural network. Wireless Communications and Mobile Computing 2022 (2022)
Durak, A., Bulut, V.: Classification and prediction-based machine learning algo- rithms to predict students’ low and high programming performance. Computer Applications in Engineering Education 32(1), 22679 (2024)
Rahman, N.H.A., Sulaiman, S.A., Ramli, N.A.: Development of predictive model for students’ final grades using machine learning techniques. In: AIP Conference Proceedings, vol. 2895 (2024). AIP Publishing
Novianto, E., Suhirman, S.: Comparison of k-nearest neighbor classification meth- ods and support vector machine in predicting students’ study period. Journal of Education & Science 33(1) (2024)
Isnaeni, I.A., Indriani, S., Zaman, M.R.N., Nugroho, A.: Comparison of k-nearest neighbors (knn) and decision tree with binary particle swarm optimization (bpso) in predicting employee performance. International Journal of Open Information Technologies 12(3), 57–65 (2024)
Rimal, Y., Sharma, N., Alsadoon, A.: The accuracy of machine learning models relies on hyperparameter tuning: student result classification using random forest, randomized search, grid search, bayesian, genetic, and optuna algorithms. Multimedia Tools and Applications, 1–16 (2024)
Batool, S., Rashid, J., Nisar, M.W., Kim, J., Kwon, H.-Y., Hussain, A.: Educa- tional data mining to predict students’ academic performance: A survey study. Education and Information Technologies 28(1), 905–971 (2023)
Abbas, S., Alsubai, S., Ojo, S., Sampedro, G.A., Almadhor, A., Hejaili, A.A., Bouazzi, I.: An efficient deep recurrent neural network for detection of cyber- attacks in realistic iot environment. The Journal of Supercomputing, 1–19 (2024)
Ashok Kumar, L., Karthika Renuka, D., Naveena, K., Sree Resmi, S.: Crdnn- bilstm knowledge distillation model towards enhancing the automatic speech recognition. SN Computer Science 5(3), 304 (2024)
Kannan, K.R., Abarna, K.M., Vairachilai, S.: Graph neural networks for pre- dicting student performance: A deep learning approach for academic success forecasting. International Journal of Intelligent Systems and Applications in Engineering 12(1s), 228–232 (2024)
Xu, K., Sun, Z.: Predicting academic performance associated with physical fit- ness of primary school students using machine learning methods. Complementary Therapies in Clinical Practice 51, 101736 (2023)
Chen, Y., Zhai, L.: A comparative study on student performance prediction using machine learning. Education and Information Technologies 28(9), 12039–12057 (2023)
A. Bhattacherjee and A. K. Badhan, “Convergence of data analytics, big data, and machine learning: applications, challenges, and future direction,” in Studies in big data, 2024, pp. 317–334.
Bharadwaj, H.K., Agarwal, A., Chamola, V., Lakkaniga, N.R., Hassija, V., Guizani, M., Sikdar, B.: A review on the role of machine learning in enabling iot based healthcare applications. IEEE Access 9, 38859–38890 (2021)
Chaudhary, P.S., Khurana, M.R., Ayalasomayajula, M.: Real-world applications of analytics data, big data, and machine learning. In: Data Analytics and Machine Learning: Navigating the Big Data Landscape, pp. 237–263. Springer, ??? (2024)
Chaitanya, K., Saha, G.C., Saha, H., Acharya, S., Singla, M.: The impact of arti- ficial intelligence and machine learning in digital marketing strategies. European Economic Letters (EEL) 13(3), 982–992 (2023)
Sarkar, C., Das, B., Rawat, V.S., Wahlang, J.B., Nongpiur, A., Tiewsoh, I., Lyn- gdoh, N.M., Das, D., Bidarolli, M., Sony, H.T.: Artificial intelligence and machine learning technology driven modern drug discovery and development. International Journal of Molecular Sciences 24(3), 2026 (2023)
Janiesch, C., Zschech, P., Heinrich, K.: Machine learning and deep learning. Electronic Markets 31(3), 685–695 (2021)
Vovk, Volodya. "Competitive on-line linear regression." Advances in Neural Information Processing Systems 10 (1997).
Qiu, Junfei, et al. "A survey of machine learning for big data processing." EURASIP Journal on Advances in Signal Processing 2016 (2016): 1-16.
Huang, Yongqiang, and Yu Sun. "A dataset of daily interactive manipulation." The International Journal of Robotics Research 38.8 (2019): 879-886.
Suganthalakshmi, T., and M. Saravanakumar. "DATA VISUALIZATION IN THE DIGITAL AGE." PRERANA: Journal of Management Thought & Practice 16.1 (2024).
Erickson, Bradley J., and Felipe Kitamura. "Magician’s corner: 9. Performance metrics for machine learning models." Radiology: Artificial Intelligence 3.3 (2021): e200126.
Yağcı, Mustafa. "Educational data mining: prediction of students' academic performance using machine learning algorithms." Smart Learning Environments 9.1 (2022): 11.
Copyright (c) 2024 Ahmed Abatal , Adil Korchi , Mourad Mzili , Toufik Mzili , Hajar Khalouki and Mohammed El Kaim Billah
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution-ShareAlikel 4.0 International (CC BY-SA 4.0) that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).
