FORMAL DESCRIPTION OF INTERACTION AND DATA FLOWS IN MULTIMODAL ASSISTIVE SYSTEMS FOR USER AUTONOMY SUPPORT

Abstract

The growing number of people with disabilities, particularly among war veterans, generates a pressing demand for technological solutions capable of providing support in everyday activities, mobility, education, and information access. This paper presents a formalized description of multimodal data flows within context-aware assistive interaction systems designed for users with special needs. A complete data processing cycle is described – from the initial input (including voice commands, visual cues, spatial parameters, and physiological indicators) to the generation of an adaptive system response, tailored to the current context such as environment, user condition, and interaction history. Special attention is given to the synchronization of input channels and prioritization strategies in cases of incomplete or noisy data. Representative use-case contexts are explored (e.g., spatial navigation, information requests, task execution), in which the system must adapt its output in the form of voice prompts, visual guidance, or haptic feedback. A functional model is proposed, outlining the key stages of processing: identification of the user’s state, dynamic update of their ergonomic profile, and selection of the most relevant interaction scenario. The paper also addresses technological constraints, including sensor data quality, influence of external conditions (lighting, noise, spatial obstacles), computational demands, and the need for user-specific personalization. The proposed description provides a foundation for further development and implementation in multimodal systems for indoor navigation, independent living support, educational platforms, and information access services for individuals with disabilities.