Enhanced personalized learning exercise question recommendation model based on knowledge tracing

(1) * Pei Pei Mail (National University Manila Philippines, and Anhui Sanlian University, China)
(2) Rodolfo C. Raga Jr. Mail (National University, Manila, Philippines)
(3) Mideth Abisado Mail (National University, Manila, Philippines)
*corresponding author

Abstract


Personalized exercise question recommendation is a crucial aspect of smart education used to customize educational exercises and questions to individual students' distinct abilities and learning progress. Integrating cognitive diagnosis with deep learning has shown promising results in personalized exercise recommendations. However, the black-box nature of the deep learning model hinders their interpretability. This makes it challenging for educators and students to understand the reasons behind the model's predictions for the next problem, and this limits their opportunity to take an active role in improving the learning process. To address this limitation, this article presents a novel personalized exercise question recommendation model based on knowledge tracing. The approach incorporates graph convolutional neural networks to model the student's abilities, thus enhancing the interpretability of the model. By employing Bidirectional gate recurrent unit (Bi-GRU), the model effectively traces fluctuations in students' abilities over time and predicts their responses to exercise questions. Experimental results demonstrate the effectiveness of this model, achieving an accuracy of 90.8% and 92.6% on ASSISTment 2009 and ASSISTment 2017 datasets, containing 4218 and 1709 student records, respectively. Moreover, the experiment was also conducted to validate the model's exercise difficulty setting. Results indicate an acceptable level of effectiveness in generating appropriate difficulty-level recommendations for individual students. The proposed model contributes to advancing personalized exercise recommendations by offering valuable insights that can lead to more efficient and effective student learning experiences.

Keywords


Knowledge tracing;Personalized learning recommendation;Graph Neural Network;Cognitive diagnosis

   

DOI

https://doi.org/10.26555/ijain.v10i1.1136
      

Article metrics

Abstract views : 518 | PDF views : 84

   

Cite

   

Full Text

Download

References


[1] M. V. Amazona and A. A. Hernandez, “Modelling Student Performance Using Data Mining Techniques,” in Proceedings of the 2019 5th International Conference on Computing and Data Engineering, May 2019, pp. 36–40, doi: 10.1145/3330530.3330544.

[2] M. Liu, P. Shao, and K. Zhang, “Graph-Based Exercise- and Knowledge-Aware Learning Network for Student Performance Prediction,” in Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 13069 LNAI, Springer Science and Business Media Deutschland GmbH, 2021, pp. 27–38, doi: 10.1007/978-3-030-93046-2_3.

[3] T. He, “Information Overload and Interaction Overload as Two Separate Attributes of Information Overload Syndrome,” J. Enterprising Cult., vol. 28, no. 03, pp. 263–279, Sep. 2020, doi: 10.1142/S0218495821500114.

[4] Y. Liang, T. Peng, Y. Pu, and W. Wu, “HELP-DKT: an interpretable cognitive model of how students learn programming based on deep knowledge tracing,” Sci. Rep., vol. 12, no. 1, p. 4012, Mar. 2022, doi: 10.1038/s41598-022-07956-0.

[5] L. Li and Z. Wang, “Knowledge relation rank enhanced heterogeneous learning interaction modeling for neural graph forgetting knowledge tracing,” PLoS One, vol. 18, no. 12, p. e0295808, Dec. 2023, doi: 10.1371/journal.pone.0295808.

[6] J. Yu et al., “MoocRadar: A Fine-grained and Multi-aspect Knowledge Repository for Improving Cognitive Student Modeling in MOOCs,” in Proceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval, Jul. 2023, pp. 2924–2934, doi: 10.1145/3539618.3591898.

[7] J. de la Torre, “DINA Model and Parameter Estimation: A Didactic,” J. Educ. Behav. Stat., vol. 34, no. 1, pp. 115–130, Mar. 2009, doi: 10.3102/1076998607309474.

[8] Q. Bin, Z. Hong-xia, W. Yu, and L. Ji-xing, “Questions Recommendation Based on Collaborative Filtering and Cognitive Diagnosis,” Computer Science, vol. 14, no. 11, pp. 235-240, 2019. [Online]. Available at: https://www.jsjkx.com/EN/10.11896/jsjkx.180901827.

[9] S. Rui-Ting, L. Yi-Cheng, and S. Yi, “Collaborative Filtering Algorithm Based on Cognitive Diagnosis,” Comput. Syst. Appl., vol. 27, no. 3, pp. 136–142, 2018. [Online]. Available at: http://www.c-s-a.org.cn/csaen/article/abstract/6239?st=article_issue.

[10] J. de la Torre and J. A. Douglas, “Higher-order latent trait models for cognitive diagnosis,” Psychometrika, vol. 69, no. 3, pp. 333–353, Sep. 2004, doi: 10.1007/BF02295640.

[11] T. Dong-Bo, C. Yan, D. Hai-Qi, and D. Shu-Liang, “A Polytomous Cognitive Diagnosis Model: P- DINA Model,” Acta Psychol. Sin., vol. 42, no. 11, pp. 1011–1020, 2011, doi: 10.3724/SP.J.1041.2010.01011.

[12] Q. Liu et al., “Fuzzy Cognitive Diagnosis for Modelling Examinee Performance,” ACM Trans. Intell. Syst. Technol., vol. 9, no. 4, pp. 1–26, Jul. 2018, doi: 10.1145/3168361.

[13] Y. Li, Y. Wen, X. Yi, and Z. Xu, “Revised Moadel of Fuzzy Cognitive Diagnosis Framework,” J. data Acquis. Process., vol. 32, no. 5, pp. 958–969, Apr. 2018. [Online]. Available at: http://sjcj.nuaa.edu.cn/sjcjycl/article/abstract/S201705013.

[14] J. Peichao, W. Chuan, H. Fuzhen, L. Qi, and W. Xiaodong, “Student Performance Prediction Based on Reading Cognitive Diagnosis,” Comput. Eng. Appl., vol. 58, no. 11, p. 160, Jun. 2022. [Online]. Available at: http://cea.ceaj.org/EN/10.3778/j.issn.1002-8331.2010-0276.

[15] X. He, L. Liao, H. Zhang, L. Nie, X. Hu, and T.-S. Chua, “Neural Collaborative Filtering,” in Proceedings of the 26th International Conference on World Wide Web, Apr. 2017, pp. 173–182, doi: 10.1145/3038912.3052569.

[16] F. Wang et al., “Neural Cognitive Diagnosis for Intelligent Education Systems,” Proc. AAAI Conf. Artif. Intell., vol. 34, no. 04, pp. 6153–6161, Apr. 2020, doi: 10.1609/aaai.v34i04.6080.

[17] G. Li et al., “DKT-LCIRT: A Deep Knowledge Tracking Model Integrating Learning Capability and Item Response Theory,” Electronics, vol. 11, no. 20, p. 3364, Oct. 2022, doi: 10.3390/electronics11203364.

[18] A. T. Corbett and J. R. Anderson, “Knowledge tracing: Modeling the acquisition of procedural knowledge,” User Model. User-Adapted Interact., vol. 4, no. 4, pp. 253–278, Dec. 1995, doi: 10.1007/BF01099821.

[19] R. J. Williams and D. Zipser, “A Learning Algorithm for Continually Running Fully Recurrent Neural Networks,” Neural Comput., vol. 1, no. 2, pp. 270–280, Jun. 1989, doi: 10.1162/neco.1989.1.2.270.

[20] C. Piech et al., “Deep Knowledge Tracing,” in Advances in Neural Information Processing Systems, 2015, vol. 28, pp. 505–513. [Online]. Available at: https://stanford.edu/~cpiech/bio/papers/deepKnowledgeTracing.pdf.

[21] C.-K. Yeung and H. Kong, “Deep-IRT: Make Deep Learning Based Knowledge Tracing Explainable Using Item Response Theory,” EDM 2019 - Proc. 12th Int. Conf. Educ. Data Min., pp. 683–686, Apr. 2019. [Online]. Available at: https://arxiv.org/abs/1904.11738.

[22] T. N. Kipf and M. Welling, “Semi-Supervised Classification with Graph Convolutional Networks,” 5th Int. Conf. Learn. Represent. ICLR 2017 - Conf. Track Proc., pp. 1–14, Sep. 2016. [Online]. Available at: https://arxiv.org/abs/1609.02907v4.

[23] F. Wu, T. Zhang, A. Holanda De Souza, C. Fifty, T. Yu, and K. Q. Weinberger, “Simplifying Graph Convolutional Networks,” in Proceedings of Machine Learning Research, 2019, p. 11. [Online]. Available at: https://proceedings.mlr.press/v97/wu19e/wu19e.pdf.

[24] S. Peng and T. Mine, “A Robust Hierarchical Graph Convolutional Network Model for Collaborative Filtering,” arXiv, p. 11, Apr. 2020. [Online]. Available at: https://arxiv.org/abs/2004.14734.

[25] X. Song, J. Li, Q. Lei, W. Zhao, Y. Chen, and A. Mian, “Bi-CLKT: Bi-Graph Contrastive Learning based Knowledge Tracing,” Knowledge-Based Syst., vol. 241, p. 108274, Apr. 2022, doi: 10.1016/j.knosys.2022.108274.

[26] D. P. Kingma and J. L. Ba, “Adam: A Method for Stochastic Optimization,” 3rd International Conference on Learning Representations, ICLR 2015 - Conference Track Proceedings. International Conference on Learning Representations, ICLR, pp. 1–15, Dec. 22, 2014. [Online]. Available at: https://arxiv.org/abs/1412.6980v9.

[27] X. Xiong, S. Zhao, E. G. Van Inwegen, and J. E. Beck, “Going Deeper with Deep Knowledge Tracing.,” in International Educational Data Mining Society, 2016, pp. 545–550. [Online]. Available: https://eric.ed.gov/?id=ED592679.

[28] X. Xiong, S. Zhao, E. G. Van Inwegen, and J. E. Beck, “Going Deeper with Deep Knowledge Tracing.” 2015, [Online]. Available at: https://github.com/chrispiech/DeepKnowledgeTracing.

[29] L. Peng and C. Wei, “Online Item Response Theory (OIRT) - Tracking Student Abilities in Online Learning System,” Proc. 15th Int. Conf. Educ. Data Mining, EDM 2022, p. 720, 2022. [Online]. Available at: https://zenodo.org/records/6853004.

[30] Z. Machardy and Z. A. Pardos, “Evaluating The Relevance of Educational Videos using BKT and Big Data,” Proc. 8th Int. Conf. Educ. Data Min., pp. 424–427, 2015, [Online]. Available at: https://files.eric.ed.gov/fulltext/ED560875.pdf.

[31] S. Xu, M. Sun, W. Fang, K. Chen, H. Luo, and P. X. W. Zou, “A Bayesian-based knowledge tracing model for improving safety training outcomes in construction: An adaptive learning framework,” Dev. Built Environ., vol. 13, p. 100111, Mar. 2023, doi: 10.1016/j.dibe.2022.100111.

[32] L. Meng, M. Zhang, W. Zhang, and Y. Chu, “CS-BKT: introducing item relationship to the Bayesian knowledge tracing model,” Interact. Learn. Environ., vol. 29, no. 8, pp. 1393–1403, Nov. 2021, doi: 10.1080/10494820.2019.1629600.

[33] R. Salakhutdinov and A. Mnih, “Probabilistic matrix factorization,” in Advances in Neural Information Processing Systems 20 - Proceedings of the 2007 Conference, 2008, pp. 1–8, [Online]. Available at: https://proceedings.neurips.cc/paper_files/paper/2007/file/d7322ed717dedf1eb4e6e52a37ea7bcd-Paper.pdf.

[34] Y. Chen et al., “Tracking Knowledge Proficiency of Students with Educational Priors,” in Proceedings of the 2017 ACM on Conference on Information and Knowledge Management, Nov. 2017, vol. Part F1318, pp. 989–998, doi: 10.1145/3132847.3132929.

[35] a Toscher and M. Jahrer, “Collaborative filtering applied to educational data mining,” KDD Cup, pp. 1–11, 2010, [Online]. Available at: http://pslcdatashop.org/KDDCup/workshop/papers/KDDCup2010_Toescher_Jahrer.pdf.

[36] Z. Wu, M. Li, Y. Tang, and Q. Liang, “Exercise recommendation based on knowledge concept prediction,” Knowledge-Based Syst., vol. 210, p. 106481, Dec. 2020, doi: 10.1016/j.knosys.2020.106481.




Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

___________________________________________________________
International Journal of Advances in Intelligent Informatics
ISSN 2442-6571  (print) | 2548-3161 (online)
Organized by UAD and ASCEE Computer Society
Published by Universitas Ahmad Dahlan
W: http://ijain.org
E: info@ijain.org (paper handling issues)
   andri.pranolo.id@ieee.org (publication issues)

View IJAIN Stats

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0