Requirement analysis and sensor specifications – First version

In this first version of the deliverable, we make the following contributions: to design theWEKIT capturing platform and the associated experience capturing API, we use amethodology for system engineering that is relevant for different domains such as: aviation,space, and medical and different professions such as: technicians, astronauts, and medicalstaff. Furthermore, in the methodology, we explore the system engineering process and how it can be used in the project to support the different work packages and more importantly the different deliverables that will follow the current. Next, we provide a mapping of high level functions or tasks (associated with experiencetransfer from expert to trainee) to low level functions such as: gaze, voice, video, bodyposture, hand gestures, bio-signals, fatigue levels, and location of the user in theenvironment. In addition, we link the low level functions to their associated sensors. Moreover, we provide a brief overview of the state-of-the-art sensors in terms of theirtechnical specifications, possible limitations, standards, and platforms. We outline a set of recommendations pertaining to the sensors that are most relevant forthe WEKIT project taking into consideration the environmental, technical and humanfactors described in other deliverables. We recommend Microsoft Hololens (for Augmentedreality glasses), MyndBand and Neurosky chipset (for EEG), Microsoft Kinect and Lumo Lift(for body posture tracking), and Leapmotion, Intel RealSense and Myo armband (for handgesture tracking). For eye tracking, an existing eye-tracking system can be customised tocomplement the augmented reality glasses, and built-in microphone of the augmentedreality glasses can capture the expert’s voice. We propose a modular approach for the designof the WEKIT experience capturing system, and recommend that the capturing systemshould have sufficient storage or transmission capabilities.Finally, we highlight common issues associated with the use of different sensors. We consider that the set of recommendations can be useful for the design and integration of theWEKIT capturing platform and the WEKIT experience capturing API to expedite the timerequired to select the combination of sensors which will be used in the first prototype.

WEKIT project delivarable D3.1.