How can Interaction Data be Contextualized with Mobile Sensing to Enhance Learning Engagement Assessment in Distance Learning?

George-Petru Ciordas-Hertel, Daniel Biedermann, Marc Winter, Julia Mordel, Hendrik Drachsler

Research output: Chapter in Book/Report/Conference proceedingConference Article in proceedingAcademicpeer-review


Multimodal learning analytics can enrich interaction data with contextual information through mobile sensing. Information about, for example, the physical environment, movement, physiological signals, or smart wearable usage. Through the use of smart wearables, contextual information can thus be captured and made available again to students in further processing steps so that they can reflect and annotate it. This paper describes a software infrastructure and a study design that successfully captured contextual information utilizing mobile sensing using students’ smart wearables in distance learning. In the conducted study, data was collected from the smartphones of 76 students as they self-directedly participated in an online learning unit using a learning management system (LMS) over a two-week period. During the students’ active phases in the LMS, interaction data as well as state and trait measurements were collected by the LMS. Simultaneously, hardware sensor data, app usage data, interaction with notifications, and ecological momentary assessments (EMA) were automatically but transparently collected from the students’ smartphones. Finally, this paper describes some preliminary insights from the study process and their implications for further data processing.
Original languageEnglish
Title of host publicationICMI 2022 - Companion Publication of the 2022 International Conference on Multimodal Interaction
Editors Raj Tumuluri, Nicu Manuel Sebe, Gopal S Pingali, Dinesh Babu Jayagopi, Abhinav Dhall, Richa Singh, Lisa Anthony, Albert Ali Salah
PublisherAssociation for Computing Machinery
Number of pages8
ISBN (Print)978-1-4503-9390-4
Publication statusPublished - 7 Nov 2022
Event24th ACM International Conference on Multimodal Interaction - Bengaluru, India
Duration: 7 Nov 202211 Nov 2022
Conference number: 24


Conference24th ACM International Conference on Multimodal Interaction
Abbreviated titleICMI '22
Internet address


  • context-awareness
  • distance learning
  • learning engagement
  • mobile sensing
  • multimodal learning analytics
  • physical learning environment


Dive into the research topics of 'How can Interaction Data be Contextualized with Mobile Sensing to Enhance Learning Engagement Assessment in Distance Learning?'. Together they form a unique fingerprint.

Cite this