Detecting Medical Simulation Errors with Machine learning and Multimodal Data

Research output: Contribution to conferencePaperAcademic

Abstract

In this doctoral consortium paper, we introduce the CPR Tutor, an intelligent tutoring system for cardiopulmonary resuscitation (CPR) training based on the analysis of multimodal data. Using a multi-sensor setup, the CPR Tutor tracks the CPR execution of the trainee and generates automatic adaptive feedback to improve the trainee's performance. This research work is part of a PhD project entitled "Multimodal Tutor: adaptive feedback from multimodal experience capturing'', a project which investigates how to use multimodal and multi-sensor data to generate personalised feedback for training psycho-motor skills at the workplace or during medical simulations. In the CPR Tutor, we use Microsoft Kinect and Myo to track trainee's body position and the ResusciAnne QCPR manikin to get correct CPR performance metrics. We then use a validated approach, the Multimodal Pipeline, for the collection, storage, processing, annotation of multimodal data. This paper describes the preliminary results obtained in the first design of the CPR Tutor.
Original languageEnglish
Pages1-6
Number of pages6
Publication statusPublished - May 2019
Event17th Conference on Artificial Intelligence in Medicine - Poznan, Poland
Duration: 26 Jun 201929 Jun 2019
https://aime19.aimedicine.info/

Conference

Conference17th Conference on Artificial Intelligence in Medicine
Abbreviated titleAIME 2019
CountryPoland
CityPoznan
Period26/06/1929/06/19
Internet address

Fingerprint

Resuscitation
Learning systems
Feedback
Sensors
Intelligent systems
Pipelines
Processing

Cite this

Di Mitri, D. (2019). Detecting Medical Simulation Errors with Machine learning and Multimodal Data. 1-6. Paper presented at 17th Conference on Artificial Intelligence in Medicine, Poznan, Poland.
Di Mitri, D. / Detecting Medical Simulation Errors with Machine learning and Multimodal Data. Paper presented at 17th Conference on Artificial Intelligence in Medicine, Poznan, Poland.6 p.
@conference{b5783818d1be48bc8a6364cf3d88f6ec,
title = "Detecting Medical Simulation Errors with Machine learning and Multimodal Data",
abstract = "In this doctoral consortium paper, we introduce the CPR Tutor, an intelligent tutoring system for cardiopulmonary resuscitation (CPR) training based on the analysis of multimodal data. Using a multi-sensor setup, the CPR Tutor tracks the CPR execution of the trainee and generates automatic adaptive feedback to improve the trainee's performance. This research work is part of a PhD project entitled {"}Multimodal Tutor: adaptive feedback from multimodal experience capturing'', a project which investigates how to use multimodal and multi-sensor data to generate personalised feedback for training psycho-motor skills at the workplace or during medical simulations. In the CPR Tutor, we use Microsoft Kinect and Myo to track trainee's body position and the ResusciAnne QCPR manikin to get correct CPR performance metrics. We then use a validated approach, the Multimodal Pipeline, for the collection, storage, processing, annotation of multimodal data. This paper describes the preliminary results obtained in the first design of the CPR Tutor.",
author = "{Di Mitri}, D.",
year = "2019",
month = "5",
language = "English",
pages = "1--6",
note = "17th Conference on Artificial Intelligence in Medicine, AIME 2019 ; Conference date: 26-06-2019 Through 29-06-2019",
url = "https://aime19.aimedicine.info/",

}

Di Mitri, D 2019, 'Detecting Medical Simulation Errors with Machine learning and Multimodal Data', Paper presented at 17th Conference on Artificial Intelligence in Medicine, Poznan, Poland, 26/06/19 - 29/06/19 pp. 1-6.

Detecting Medical Simulation Errors with Machine learning and Multimodal Data. / Di Mitri, D.

2019. 1-6 Paper presented at 17th Conference on Artificial Intelligence in Medicine, Poznan, Poland.

Research output: Contribution to conferencePaperAcademic

TY - CONF

T1 - Detecting Medical Simulation Errors with Machine learning and Multimodal Data

AU - Di Mitri, D.

PY - 2019/5

Y1 - 2019/5

N2 - In this doctoral consortium paper, we introduce the CPR Tutor, an intelligent tutoring system for cardiopulmonary resuscitation (CPR) training based on the analysis of multimodal data. Using a multi-sensor setup, the CPR Tutor tracks the CPR execution of the trainee and generates automatic adaptive feedback to improve the trainee's performance. This research work is part of a PhD project entitled "Multimodal Tutor: adaptive feedback from multimodal experience capturing'', a project which investigates how to use multimodal and multi-sensor data to generate personalised feedback for training psycho-motor skills at the workplace or during medical simulations. In the CPR Tutor, we use Microsoft Kinect and Myo to track trainee's body position and the ResusciAnne QCPR manikin to get correct CPR performance metrics. We then use a validated approach, the Multimodal Pipeline, for the collection, storage, processing, annotation of multimodal data. This paper describes the preliminary results obtained in the first design of the CPR Tutor.

AB - In this doctoral consortium paper, we introduce the CPR Tutor, an intelligent tutoring system for cardiopulmonary resuscitation (CPR) training based on the analysis of multimodal data. Using a multi-sensor setup, the CPR Tutor tracks the CPR execution of the trainee and generates automatic adaptive feedback to improve the trainee's performance. This research work is part of a PhD project entitled "Multimodal Tutor: adaptive feedback from multimodal experience capturing'', a project which investigates how to use multimodal and multi-sensor data to generate personalised feedback for training psycho-motor skills at the workplace or during medical simulations. In the CPR Tutor, we use Microsoft Kinect and Myo to track trainee's body position and the ResusciAnne QCPR manikin to get correct CPR performance metrics. We then use a validated approach, the Multimodal Pipeline, for the collection, storage, processing, annotation of multimodal data. This paper describes the preliminary results obtained in the first design of the CPR Tutor.

UR - https://www.researchgate.net/publication/334291076_Detecting_Medical_Simulation_Errors_with_Machine_learning_and_Multimodal_Data

UR - https://www.slideshare.net/dnldimitri/multimodal-tutor-for-cpr-presented-at-aime19

M3 - Paper

SP - 1

EP - 6

ER -

Di Mitri D. Detecting Medical Simulation Errors with Machine learning and Multimodal Data. 2019. Paper presented at 17th Conference on Artificial Intelligence in Medicine, Poznan, Poland.