HYBRID MODEL FOR INTEGRAL PERFORMANCE ASSESSMENT OF AIR TRAFFIC CONTROLLERS IN SIMULATOR TRAINING USING ARTIFICIAL INTELLIGENCE TECHNOLOGIES
DOI:
https://doi.org/10.35546/kntu2078-4481.2026.2.40Keywords:
air traffic control, competency-based approach, simulator training, neuro-fuzzy models, explainable artificial intelligence.Abstract
This research is aimed at developing a hybrid performance assessment model for air traffic controllers (ATCs) during the execution of emergency scenarios, integrating the ICAO Competency-Based Training and Assessment (CBTA) framework with Artificial Intelligence (AI) technologies. A logical-algorithmic architecture is employed to analyze ATC simulator telemetry alongside Natural Language Processing (NLP) technologies. To aggregate objective machinegenerated data and subjective instructor evaluations, a Sugeno-type Adaptive Neuro-Fuzzy Inference System (ANFIS) is utilized. Machine Learning (ML) algorithms are applied to dynamically adjust the penalty indices within the defined error taxonomy. The application of ANFIS enabled the mathematical mitigation of the human factor's epistemic uncertainty during the scoring process. The implementation of explainable AI methodology based on SHAP analysis ensures absolute transparency of the automatically generated scores, providing visually structured reports for post-simulation debriefings. The proposed hybrid assessment model algorithmizes a specialized ATC error taxonomy through dynamic ML-driven weighting. Unlike static models, the applied approach allows the assessment system to continuously adapt to the spatiotemporal complexity of the emergency situation itself, the capabilities of the controller working position equipment, active airspace restrictions and limitations, and the evolution of general air traffic and meteorological conditions within the ATC's sector of responsibility and adjacent sectors. The proposed integral performance assessment model for ATC simulator training minimizes the subjectivity of instructor oversight regarding the professional proficiency level of ATCs and facilitates the generation of individualized training trajectories for the targeted remediation of skill gaps. The synergy of the instructor's assessment component and the simulator's digital data through neuro-fuzzy modeling establishes a robust mechanism that modernizes simulator evaluation processes in compliance with current ICAO and EASA standards to enhance flight safety.
References
Network operations report 2024 (Final report). V.1.0. EUROCONTROL – May 2025. 66 p.
High-level Summary Report on Preliminary ACE 2024 Data. EUROCONTROL – December 2025. 19 p.
Doc 10056. Manual on Air Traffic Controller Competency-based Training and Assessment. Vol. I : Air Traffic Control (ATC). 2nd ed. Montreal: ICAO, 2022. 326 p.
Easy Access Rules for Air Traffic Controllers’ Licensing and Certification (Regulation (EU) 2015/340) Revision from March. EASA. 2024. 702 p.
NATS: NATS unveils digital-twin platform for air traffic controller recruitment : website. URL: https://www.nats. aero/news/nats-unveils-digital-twin-platform-for-air-traffic-controller-recruitment (accessed: 15.02.2026).
Laskowski Jan, Pytka J., Laskowska A., Tomiło P., Skowron L., Kozłowski E., Piątek R., Mamcarz P. AI-Based Method of Air Traffic Controller Workload Assessment. 11th International Workshop on Metrology for AeroSpace, 2024. P. 46-51. DOI: https://doi.org/10.1109/MetroAeroSpace61015.2024.10591524.
Hu Y., Shen H., Wang B. Core Competency Assessment Model for Entry-Level Air Traffic Controllers Based on International Civil Aviation Organization Document 10056. Aerospace. 2025. Vol. 12, Iss. 6. DOI: https://doi.org/10.3390/aerospace12060486 (accessed: 15.02.2026).
Carvell B., Thomas M., Pace A. Dorney C., De Ath G., Everson R., Pepper N., Keane A., Tomlinson S., Cannon R. Human-in-the-Loop Testing of AI Agents for Air Traffic Control with a Regulated Assessment Framework. 2026. 18 p. DOI: https://doi.org/10.48550/arXiv.2601.04288.
Antoško M., Polishchuk V., Kelemen M. Jr., Korniienko A., Kelemen M. Artificial Intelligence Technology for Assessing the Practical Knowledge of Air Traffic Controller Students Based on Their Responses in Multitasking Situations. Applied Sciences. 2025. 15(1):308. 10.3390/app15010308.
Lakshmi V. A., Addanki J., Akshaya B., Amrutha V. R. S., Towsiq S. and Sai V. H. Predictive Framework for Aviation Accident Risk Assessment using Hybrid Machine Learning Models. 6th International Conference on Electronics and Sustainable Communication Systems (ICESC). Coimbatore, India, 2025. P. 2040-2048. DOI: https://doi.org/10.1109/ICESC65114.2025.11212488.
EASA Artificial Intelligence Roadmap 2.0: Human-centric approach to AI in aviation. Ver. 2.0. Cologne, Germany, 2023. 36 p.





