Multimodal Analytics for Real-Time Feedback in Co-located Collaboration

S. Praharaj, M. Scheffel, H. Drachsler, M. Specht

    Research output: Chapter in Book/Report/Conference proceedingChapterAcademicpeer-review


    Collaboration is an important 21st century skill; it can take place in a remote or co-located setting. Co-located collaboration (CC) is a very complex process which involves subtle human interactions that can be described with multimodal indicators (MI) like gaze, speech and social skills. In this paper, we first give an overview of related work that has identified indicators during CC. Then, we look into the state-of-the-art studies on feedback during CC which also make use of MI. Finally, we describe a Wizard of Oz (WOz) study where we design a privacy-preserving research prototype with the aim to facilitate real-time collaboration in-the-wild during three co-located group PhD meetings (of 3–7 members). Here, human observers stationed in another room act as a substitute for sensors to track different speech-based cues (like speaking time and turn taking); this drives a real-time visualization dashboard on a public shared display. With this research prototype, we want to pave way for design-based research to track other multimodal indicators of CC by extending this prototype design using both humans and sensors.

    Original languageEnglish
    Title of host publicationLifelong Technology-Enhanced Learning
    Subtitle of host publicationEC-TEL 2018, Lecture notes in Computer Science
    EditorsV. Pammer-Schindler, M. Pérez-Sanagustín, H. Drachsler, R. Elferink, M. Scheffel
    Place of PublicationCham
    Number of pages15
    ISBN (Electronic)978-3-319-98572-5
    ISBN (Print)978-3-319-98571-8
    Publication statusPublished - 2018
    Event13th European Conference on Technology Enhanced Learning: Lifelong Technology-Enhanced Learning (EC-TEL 2018) - Leeds, United Kingdom
    Duration: 3 Sept 20186 Sept 2018

    Publication series

    SeriesLifelong Technology-Enhanced Learning


    Conference13th European Conference on Technology Enhanced Learning
    Abbreviated titleEC-TEL 2018
    Country/TerritoryUnited Kingdom
    Internet address


    • CSCL
    • Collaboration
    • Feedback
    • Intervention
    • Multimodal indicators
    • Multimodal learning analytics


    Dive into the research topics of 'Multimodal Analytics for Real-Time Feedback in Co-located Collaboration'. Together they form a unique fingerprint.

    Cite this