Multimodal Pipeline: A generic approach for handling multimodal data for supporting learning

Research output: Contribution to conferencePaperAcademic

11 Downloads (Pure)

Abstract

In this demo paper, we introduce the Multimodal Pipeline, a prototypical approach for the collection, storing, annotation, processing and exploitation of multimodal data for supporting learning. At the current stage of development, the Multimodal Pipeline consists of two relevant prototypes: 1) Multimodal Learning Hub for the collection and storing of sensor data from multiple applications and 2) the Visual Inspection Tool for visualisation and annotation of the recorded sessions. The Multimodal Pipeline is designed to be a flexible system useful for supporting psychomotor skills in a variety of learning scenarios such as presentation skills, medical simulation with patient manikins or calligraphy learning. The Multimodal Pipeline can be configured to serve different support strategies, including detecting mistakes and prompting live feedback in an intelligent tutoring system or stimulating self-reflection through a learning analytics dashboard.
Original languageEnglish
Number of pages3
Publication statusPublished - 10 Aug 2019
EventFirst workshop on AI-based Multimodal Analytics for Understanding Human Learning in Real-world Educational Contexts - Macau, China
Duration: 11 Jan 202011 Jan 2020
Conference number: 1
https://www.aima4edu.com/

Workshop

WorkshopFirst workshop on AI-based Multimodal Analytics for Understanding Human Learning in Real-world Educational Contexts
Abbreviated titleAIMA4EDU
CountryChina
CityMacau
Period11/01/2011/01/20
Internet address

    Fingerprint

Cite this

Di Mitri, D., Schneider, J., Specht, M. M., & Drachsler, H. J. (2019). Multimodal Pipeline: A generic approach for handling multimodal data for supporting learning. Paper presented at First workshop on AI-based Multimodal Analytics for Understanding Human Learning in Real-world Educational Contexts, Macau, China.