Multimodal Pipeline: A generic approach for handling multimodal data for supporting learning

D. Di Mitri, Jan Schneider, M.M. Specht, H.J. Drachsler

    Research output: Contribution to conferencePaperAcademic

    62 Downloads (Pure)

    Abstract

    In this demo paper, we introduce the Multimodal Pipeline, a prototypical approach for the collection, storing, annotation, processing and exploitation of multimodal data for supporting learning. At the current stage of development, the Multimodal Pipeline consists of two relevant prototypes: 1) Multimodal Learning Hub for the collection and storing of sensor data from multiple applications and 2) the Visual Inspection Tool for visualisation and annotation of the recorded sessions. The Multimodal Pipeline is designed to be a flexible system useful for supporting psychomotor skills in a variety of learning scenarios such as presentation skills, medical simulation with patient manikins or calligraphy learning. The Multimodal Pipeline can be configured to serve different support strategies, including detecting mistakes and prompting live feedback in an intelligent tutoring system or stimulating self-reflection through a learning analytics dashboard.
    Original languageEnglish
    Number of pages3
    Publication statusPublished - 10 Aug 2019
    EventFirst workshop on AI-based Multimodal Analytics for Understanding Human Learning in Real-world Educational Contexts - Macau, China
    Duration: 11 Jan 202011 Jan 2020
    Conference number: 1
    https://www.aima4edu.com/

    Workshop

    WorkshopFirst workshop on AI-based Multimodal Analytics for Understanding Human Learning in Real-world Educational Contexts
    Abbreviated titleAIMA4EDU
    Country/TerritoryChina
    CityMacau
    Period11/01/2011/01/20
    Internet address

    Fingerprint

    Dive into the research topics of 'Multimodal Pipeline: A generic approach for handling multimodal data for supporting learning'. Together they form a unique fingerprint.

    Cite this