A fuzzy logic approach to reliable real-time recognition of facial emotions

Kiavash Bahreini, Wim van der Vegt, Wim Westera

Research output: Contribution to journalArticleAcademicpeer-review

1 Downloads (Pure)

Abstract

This paper represents our newly developed software for emotion recognition from facial expressions. Besides allowing emotion recognition from image files and recorded video files, it uses webcam data to provide real-time, continuous, and unobtrusive facial emotional expressions. It uses FURIA algorithm for unordered fuzzy rule induction to offer timely and appropriate feedback based on learners’ facial expressions. The main objective of this study was first to validate the use of webcam data for a real-time and accurate analysis of facial expressions in e-learning environments. Second, transform these facial expressions to detected emotional states using the FURIA algorithm. We measured the performance of the software with ten participants, provided them with the same computer-based tasks, requested them a hundred times to mimic specific facial expressions, and recorded all sessions on video. We used the recorded video files to feed our newly developed software. We then used two experts’ opinions to annotate and rate participants’ recorded behaviours and to validate the software’s results. The software provides accurate and reliable results with the overall accuracy of 83.2%, which is comparable to the recognition by humans. This study will help to increase the quality of e-learning.
Original languageEnglish
Number of pages14
JournalMultimedia Tools and Applications
Publication statusE-pub ahead of print - 6 Feb 2019

Fingerprint

Fuzzy logic
Fuzzy rules
Feedback

Keywords

  • Emotion recognition
  • Affective computing
  • Software development
  • statistical data analysis
  • fuzzy logic
  • webcam
  • e-learning

Cite this

@article{9f5eeba15ef041c09881cf704bbea846,
title = "A fuzzy logic approach to reliable real-time recognition of facial emotions",
abstract = "This paper represents our newly developed software for emotion recognition from facial expressions. Besides allowing emotion recognition from image files and recorded video files, it uses webcam data to provide real-time, continuous, and unobtrusive facial emotional expressions. It uses FURIA algorithm for unordered fuzzy rule induction to offer timely and appropriate feedback based on learners’ facial expressions. The main objective of this study was first to validate the use of webcam data for a real-time and accurate analysis of facial expressions in e-learning environments. Second, transform these facial expressions to detected emotional states using the FURIA algorithm. We measured the performance of the software with ten participants, provided them with the same computer-based tasks, requested them a hundred times to mimic specific facial expressions, and recorded all sessions on video. We used the recorded video files to feed our newly developed software. We then used two experts’ opinions to annotate and rate participants’ recorded behaviours and to validate the software’s results. The software provides accurate and reliable results with the overall accuracy of 83.2{\%}, which is comparable to the recognition by humans. This study will help to increase the quality of e-learning.",
keywords = "Emotion recognition, Affective computing, Software development, statistical data analysis, fuzzy logic, webcam, e-learning",
author = "Kiavash Bahreini and {van der Vegt}, Wim and Wim Westera",
year = "2019",
month = "2",
day = "6",
language = "English",
journal = "Multimedia Tools and Applications",
issn = "1380-7501",
publisher = "Springer Netherlands",

}

A fuzzy logic approach to reliable real-time recognition of facial emotions. / Bahreini, Kiavash; van der Vegt, Wim; Westera, Wim.

In: Multimedia Tools and Applications, 06.02.2019.

Research output: Contribution to journalArticleAcademicpeer-review

TY - JOUR

T1 - A fuzzy logic approach to reliable real-time recognition of facial emotions

AU - Bahreini, Kiavash

AU - van der Vegt, Wim

AU - Westera, Wim

PY - 2019/2/6

Y1 - 2019/2/6

N2 - This paper represents our newly developed software for emotion recognition from facial expressions. Besides allowing emotion recognition from image files and recorded video files, it uses webcam data to provide real-time, continuous, and unobtrusive facial emotional expressions. It uses FURIA algorithm for unordered fuzzy rule induction to offer timely and appropriate feedback based on learners’ facial expressions. The main objective of this study was first to validate the use of webcam data for a real-time and accurate analysis of facial expressions in e-learning environments. Second, transform these facial expressions to detected emotional states using the FURIA algorithm. We measured the performance of the software with ten participants, provided them with the same computer-based tasks, requested them a hundred times to mimic specific facial expressions, and recorded all sessions on video. We used the recorded video files to feed our newly developed software. We then used two experts’ opinions to annotate and rate participants’ recorded behaviours and to validate the software’s results. The software provides accurate and reliable results with the overall accuracy of 83.2%, which is comparable to the recognition by humans. This study will help to increase the quality of e-learning.

AB - This paper represents our newly developed software for emotion recognition from facial expressions. Besides allowing emotion recognition from image files and recorded video files, it uses webcam data to provide real-time, continuous, and unobtrusive facial emotional expressions. It uses FURIA algorithm for unordered fuzzy rule induction to offer timely and appropriate feedback based on learners’ facial expressions. The main objective of this study was first to validate the use of webcam data for a real-time and accurate analysis of facial expressions in e-learning environments. Second, transform these facial expressions to detected emotional states using the FURIA algorithm. We measured the performance of the software with ten participants, provided them with the same computer-based tasks, requested them a hundred times to mimic specific facial expressions, and recorded all sessions on video. We used the recorded video files to feed our newly developed software. We then used two experts’ opinions to annotate and rate participants’ recorded behaviours and to validate the software’s results. The software provides accurate and reliable results with the overall accuracy of 83.2%, which is comparable to the recognition by humans. This study will help to increase the quality of e-learning.

KW - Emotion recognition

KW - Affective computing

KW - Software development

KW - statistical data analysis

KW - fuzzy logic

KW - webcam

KW - e-learning

M3 - Article

JO - Multimedia Tools and Applications

JF - Multimedia Tools and Applications

SN - 1380-7501

ER -