AN AGENT-BASED MODEL FOR PERSONALIZED LEARNING IN NETLOGO USING Q-LEARNING

Authors

DOI:

https://doi.org/10.32782/mathematical-modelling/2025-8-1-1

Keywords:

agent-based modeling, reinforcement learning, Q-learning, personalized learning, learning style, intel- ligent tutoring system, NetLogo

Abstract

This study investigates the effectiveness of using the Q-learning reinforcement learning algorithm in the context of personalized student learning by constructing an agent-based model in the NetLogo simulation environment. The proposed model assumes the existence of a population of student agents, each possessing individual characteristics, especially a distinct learning style (visual, auditory, or kinesthetic). The learning environment is modeled as a grid of patches, each containing educational content of a particular type (textual, video, or audio) and a specified difficulty level.Agents interact with the environment by making decisions to either stay on their current location or move to another patch, based on an ε-greedy action selection strategy. The Q-learning algorithm enables each agent to form and continuously update its own Q-table, which stores the utility estimates of various actions in different states. The reward is determined by the degree of alignment between the agent’s learning style and the content type. If the style matches the content format (e.g., auditory style and audio material), the agent receives a positive reward; otherwise, a negative one.The results of a series of simulations showed that agents gradually learn to avoid mismatched content and begin to prefer patches that correspond to their perception style. An increase in average reward, a growing proportion of agents with positive outcomes, and a decrease in the frequency of random movements over time were observed. This indicates the formation of a stable learning policy and effective adaptation to the environmental conditions. Moreover, the influence of Q-learning parameters (ε, α, γ) on learning success was analyzed, allowing for the identification of optimal configurations for achieving the best performance. The obtained results confirm the relevance of using reinforcement learning approaches to model personalized educational strategies. The proposed model can be used as a foundation for the development of intelligent learning support systems capable of adapting the educational process to individual learners’ needs and traits.

References

Bazzanella E., Santos F. Does a Q-learning NetLogo Extension Simplify the Development of gent-based Simulations? Proceedings of the 15th Workshop-School on Agents, Environments, and Applications (WESAAC 2021), Porto Alegre, 2021. P. 1–12. https://doi.org/10.5753/wesaac.2021.33403.

Bazzanella E., Barros M.M., Santos F. Refactoring the NetLogo Reinforcement Learning Extension for Integration with the BURLAP Library. Proceedings of the 18th Workshop-School on Agents, Environments, and Applications (WESAAC 2024). Porto Alegre, 2024. P. 51–62. https://doi.org/10.5753/wesaac.2024.33455.

Amzil I., Aammou S., Tagdimi Z., Erradi H. Personalizing Learning Experiences with Q-Learning in Adaptive Educational Systems E-Learning and Smart Engineering Systems (ELSES 2023). Atlantis Press, 2023. P. 70–77. DOI: 10.2991/978-94-6463-360-3_9.

Dahan A., Roth N., Pelosi A.D., Reiner M. A Reinforcement Learning Framework for Personalized Adaptive E-Learning. Advanced Technologies and the University of the Future. Lecture Notes in Networks and Systems. Springer, Cham. 2024. Vol. 1140. P. 141–162. https://doi.org/10.1007/978-3-031-71530-3_10.

Mon B.F., Wasfi A., Hayajneh M., Slim A., Abu Ali N. Reinforcement Learning in Education: A Literature Review. Informatics. 2023. Vol. 10 (3). P. 74. https://doi.org/10.3390/ informatics10030074.

Alharbi K., Cristea A.I., Shi L., Tymms P., Brown C. Agent-Based Simulation of the Classroom Environment to Gauge the Effect of Inattentive or Disruptive Students. Intelligent Tutoring Systems (ITS 2021). Lecture Notes in Computer Science, Vol. 12677. Springer, Cham. 2021. P. 211–223. https://doi.org/10.1007/978-3-030-80421-3_23.

Alharbi K., Cristea A.I. Hybrid Agent-Based Machine Learning Simulation of a Classroom Disruption Model Proceeding of the 38th ECMS conference, editors: Daniel Grzonka, Natalia Rylko, Grazyna Suchacka, Vladimir Mityushev. 2024. Vol. 38. № 1. P. 125–132.

Govea J., Maldonado Navarro A., Sánchez-Viteri S., Villegas-Ch. W. Implementation of Deep Reinforcement Learning Models for Emotion Detection and Personalization of Learning in Hybrid Educational Environments. Front. Artif. Intell. 2024. Vol. 7. P. 1458230. https://doi.org/10.3389/frai.2024.1458230.

Osakwe I., Chen G., Fan Y., Rakovic M., Li X., Singh S., Molenaar I., Bannert M., Gašević D. Reinforcement Learning for Automatic Detection of Effective Strategies for Self-Regulated Learning. Computers and Education: Artificial Intelligence. 2023. Vol. 5. P. 100181. https://doi.org/10.1016/j.caeai.2023.100181.

Axak N., Tatarnykov A., Kushnaryov M. Agent-based method of improving the efficiency of the e-learning. Proceedings of the 12th International Scientific and Practical Conference Information Control Systems and Technologies, ICST 2024. Vol. 3790. P. 63–75. URL: http://www.scopus.com/inward/record.url?eid=2-s2.0-85207827452&partnerID=MN8TOARS.

Published

2025-05-27