Machine Learning for Predicting Student Academic Performance: A Case Study at a Public University
DOI:
https://doi.org/10.69930/fsst.v3i2.947Keywords:
Machine Learning; Student Performance Prediction; Educational Data Mining; Learning Analytics; XGBoostAbstract
Predicting how well a student will perform before, rather than after, a semester goes wrong is one of the more practical promises that machine learning has brought to higher education. This study reports a case study conducted at a public university, in which academic records, attendance logs, and a small set of socio-demographic indicators were used to build classification models that sort students into low, average, and high performance categories well before final examinations. Seven algorithms were trained and compared on the same dataset: logistic regression, decision tree, k-nearest neighbors, support vector machine, random forest, extreme gradient boosting (XGBoost), and a multilayer perceptron artificial neural network. After cleaning the data, encoding categorical fields, and selecting the ten most informative features through a correlation-based filter, the models were evaluated using accuracy, precision, recall, F1-score, and the area under the ROC curve, with a stratified 80/20 train-test split and five-fold cross-validation. XGBoost produced the strongest results, reaching 90.1% accuracy and an AUC of 0.95, followed closely by random forest and the neural network, while logistic regression and k-nearest neighbors trailed behind. Prior GPA, midterm score, and assignment performance emerged as the three most influential predictors, consistent with findings reported in comparable studies. The paper closes by discussing what these results mean for early-warning systems and academic advising at resource-constrained public universities, and where the approach still falls short. By turning data that public universities already collect into an early, actionable signal for advisors, this work speaks directly to Sustainable Development Goal 4 (Quality Education), particularly its emphasis on equitable learning opportunities and student retention.
References
Adnan, M., Habib, A., Ashraf, J., Mussadiq, S., Raza, A. A., Abid, M., Bashir, M., & Khan, S. U. (2021). Predicting at-risk students at different percentages of course length for early intervention using machine learning models. IEEE Access, 9, 7519–7539.
Alpaydin, E. (2020). Introduction to machine learning (4th ed.). MIT Press.
Al-Zawqari, A., Peumans, D., & Vandersteen, G. (2022). A flexible feature selection approach for predicting students' academic performance in online courses. Computers and Education: Artificial Intelligence, 3, 100103.
Baker, R. S. J. d. (2014). Educational data mining: An advance for intelligent systems in education. IEEE Intelligent Systems, 29(3), 78–82.
Baker, R. S. J. d., & Yacef, K. (2009). The state of educational data mining in 2009: A review and future visions. Journal of Educational Data Mining, 1(1), 3–16.
Baker, R. S., & Inventado, P. S. (2014). Educational data mining and learning analytics. In J. A. Larusson & B. White (Eds.), Learning analytics: From research to practice (pp. 61–75). Springer.
Breiman, L. (2001). Random forests. Machine Learning, 45(1), 5–32.
Cano, A., & Leonard, J. (2019). Interpretable multi-view early warning system adapted to underrepresented student populations. IEEE Transactions on Learning Technologies, 12(2), 198–211.
Chen, T., & Guestrin, C. (2016). XGBoost: A scalable tree boosting system. In Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (pp. 785–794). ACM.
Cortes, C., & Vapnik, V. (1995). Support-vector networks. Machine Learning, 20(3), 273–297.
Cortez, P., & Silva, A. M. G. (2008). Using data mining to predict secondary school student performance. In Proceedings of the 5th Annual Future Business Technology Conference (pp. 5–12).
Cui, J., Zhang, Y., An, R., Yun, Y., Dai, H., & Shang, X. (2021). Identifying key features in student grade prediction. In Proceedings of the IEEE International Conference on Progress in Informatics and Computing (PIC) (pp. 519–523). IEEE.
Dalipi, F., Imran, A. S., & Kastrati, Z. (2018). MOOC dropout prediction using machine learning techniques: Review and research challenges. In Proceedings of the IEEE Global Engineering Education Conference (EDUCON) (pp. 1007–1014). IEEE.
Fang, T., Huang, S., Zhou, Y., & Zhang, H. (2021). Multi-model stacking ensemble learning for student achievement prediction. In Proceedings of the 12th International Symposium on Parallel Architectures, Algorithms and Programming (PAAP). IEEE.
Han, J., Kamber, M., & Pei, J. (2012). Data mining: Concepts and techniques (3rd ed.). Morgan Kaufmann.
Hastie, T., Tibshirani, R., & Friedman, J. (2009). The elements of statistical learning: Data mining, inference, and prediction (2nd ed.). Springer.
Hosmer, D. W., Jr., Lemeshow, S., & Sturdivant, R. X. (2013). Applied logistic regression (3rd ed.). Wiley.
Hussain, S., & Khan, M. Q. (2023). Student-Performulator: Predicting students' academic performance at secondary and intermediate level using machine learning. Annals of Data Science, 10(3), 637–655.
Kingma, D. P., & Ba, J. (2015). Adam: A method for stochastic optimization. In Proceedings of the International Conference on Learning Representations (ICLR).
Kotsiantis, S. B. (2012). Use of machine learning techniques for educational purposes: A decision support system for forecasting students' grades. Artificial Intelligence Review, 37(4), 331–344.
Krüger, J. G. C., Britto, A. de S., Jr., & Barddal, J. P. (2023). An explainable machine learning approach for student dropout prediction. Expert Systems with Applications, 233, 120933.
LeCun, Y., Bengio, Y., & Hinton, G. (2015). Deep learning. Nature, 521(7553), 436–444.
Manzoor, M., Umer, M., Sadiq, S., Ishaq, A., Ullah, S., Madni, H. A., & Bashir, M. (2021). RFCNN: Traffic accident severity prediction based on decision level fusion of machine and deep learning model. IEEE Access, 9, 128359–128371.
Márquez-Vera, C., Morales, C. R., & Soto, S. V. (2013). Predicting school failure and dropout by using data mining techniques. IEEE Revista Iberoamericana de Tecnologías del Aprendizaje, 8(1), 7–14.
Nabil, A., Seyam, M., & Abou-Elfetouh, A. (2021). Prediction of students' academic performance based on courses' grades using deep neural networks. IEEE Access, 9, 140731–140746.
Niyogisubizo, J., Liao, L., Nziyumva, E., Murwanashyaka, E., & Nshimyumukiza, P. C. (2022). Predicting student's dropout in university classes using two-layer ensemble machine learning approach: A novel stacked generalization. Computers and Education: Artificial Intelligence, 3, 100066.
Qiu, F., Zhang, G., Sheng, X., Jiang, L., Zhu, L., Xiang, Q., Jiang, B., & Chen, P. (2022). Predicting students' performance in e-learning using learning process and behaviour data. Scientific Reports, 12, 453.
Quinlan, J. R. (1993). C4.5: Programs for machine learning. Morgan Kaufmann.
Rish, I. (2001). An empirical study of the naive Bayes classifier. In Proceedings of the IJCAI Workshop on Empirical Methods in Artificial Intelligence, 3(22), 41–46.
Rodríguez-Hernández, C. F., Musso, M., Kyndt, E., & Cascallar, E. (2021). Artificial neural networks in academic performance prediction: Systematic implementation and predictor evaluation. Computers and Education: Artificial Intelligence, 2, 100018.
Romero, C., & Ventura, S. (2007). Educational data mining: A survey from 1995 to 2005. Expert Systems with Applications, 33(1), 135–146.
Romero, C., & Ventura, S. (2010). Educational data mining: A review of the state of the art. IEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews, 40(6), 601–618.
Romero, C., & Ventura, S. (2013). Data mining in education. Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery, 3(1), 12–27.
Romero, C., & Ventura, S. (2020). Educational data mining and learning analytics: An updated survey. Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery, 10(3), e1355.
Romero, C., Ventura, S., Hervás, C., & González, P. (2008). Data mining algorithms to classify students. In Proceedings of the 1st International Conference on Educational Data Mining (pp. 8–17).
Siemens, G., & Baker, R. S. J. d. (2012). Learning analytics and educational data mining: Towards communication and collaboration. In Proceedings of the 2nd International Conference on Learning Analytics and Knowledge (LAK) (pp. 252–254). ACM.
Sukhija, K., Jindal, M., & Aggarwal, N. (2016). Educational data mining towards knowledge engineering: A review state. International Journal of Management in Education, 10(1), 65.
Vapnik, V. N. (1995). The nature of statistical learning theory. Springer.
Witten, I. H., Frank, E., & Hall, M. A. (2011). Data mining: Practical machine learning tools and techniques (3rd ed.). Morgan Kaufmann.
Xie, Y. (2021). Student performance prediction via attention-based multi-layer long-short term memory. Journal of Computer and Communications, 9(4), 61–79.
