Immersive Multimodal Environments for Psychomotor Skills Training

The coordination of psychomotor skills requires deliberate practice and techniques, all of which are typically taught in the physical setting, where
instructions and timely feedback are given by the teachers. However, doing so remotely is commonly ineffective and therefore, affecting the learner’s progress to achieve their goal in a shorter time. Educational researchers in the technology-enhanced learning and artificial intelligence (AI) are progressively embedding sensor technologies for the collection of multimodal data, and machine learning approaches for tracking learner’s behavior and progress in authentic learning contexts. Further, immersive technologies such as virtual reality (VR), augmented reality (AR) and game elements enable the creation of virtual training environments or simulations that typically consist realistic physical similarity to an actual learning context.
In this research, we aim to design and implement an immersive training environment for psychomotor skills using immersive technologies that deliver instructions and feedback to learners in a meaningful manner. Furthermore, we intend to investigate the effectiveness of the system and whether it can be applied to train skills in different psychomotor domains.