Evaluating the usability of authoring environments for serious games

Aad Slootmaker*, Hans Hummel, Rob Koper

*Corresponding author for this work

Research output: Contribution to journalArticleAcademicpeer-review

Abstract

Background: The EMERGO method and online platform enable the development and delivery ofscenario-based serious games that foster students to acquire professional competence. One of themain goals of the platform is to provide a user-friendly authoring environment for creating virtualenvironments where students can perform authentic tasks. Aim: We present the findings of an in-depth qualitative case study of the platform´s authoringenvironment and compare our findings on usability with those found for comparable environmentsin literature. Method: We carried out semi-structured interviews, with two experienced game developers whohave authored a game for higher education, and a literature review of comparable environments. Findings: The analysis shows that the usability of the authoring environment is problematic,especially regarding understandability and learnability, which is in line with findings ofcomparable environments. Other findings are that authoring is well integrated with the EMERGOmethod and that functionality and reliability of the authoring environment are valued. Practical implications: The lessons learned are presented in the form of general guidelines toimprove the understandability and learnability of authoring environments for serious games.
Original languageEnglish
Pages (from-to)553-578
Number of pages26
JournalSimulation & Gaming
Volume48
Issue number4
DOIs
Publication statusPublished - 1 Aug 2017

Fingerprint

Students
Education
Serious games
Usability
Learnability

Keywords

  • authoring environment
  • development process
  • functionality
  • game design research,
  • learnability
  • operability
  • reliability
  • scenario-based serious games
  • understandability
  • usability

Cite this

@article{1f26414779d140cfa978e747048e51ad,
title = "Evaluating the usability of authoring environments for serious games",
abstract = "Background: The EMERGO method and online platform enable the development and delivery ofscenario-based serious games that foster students to acquire professional competence. One of themain goals of the platform is to provide a user-friendly authoring environment for creating virtualenvironments where students can perform authentic tasks. Aim: We present the findings of an in-depth qualitative case study of the platform´s authoringenvironment and compare our findings on usability with those found for comparable environmentsin literature. Method: We carried out semi-structured interviews, with two experienced game developers whohave authored a game for higher education, and a literature review of comparable environments. Findings: The analysis shows that the usability of the authoring environment is problematic,especially regarding understandability and learnability, which is in line with findings ofcomparable environments. Other findings are that authoring is well integrated with the EMERGOmethod and that functionality and reliability of the authoring environment are valued. Practical implications: The lessons learned are presented in the form of general guidelines toimprove the understandability and learnability of authoring environments for serious games.",
keywords = "authoring environment, development process, functionality, game design research,, learnability, operability, reliability, scenario-based serious games, understandability, usability",
author = "Aad Slootmaker and Hans Hummel and Rob Koper",
note = "DS_Citation:Slootmaker, A., Hummel, H. G. K., & Koper, E. J. R. (2017). Evaluating the usability of development platforms for serious games. Simulations and Gaming.",
year = "2017",
month = "8",
day = "1",
doi = "10.1177/1046878117705249",
language = "English",
volume = "48",
pages = "553--578",
journal = "Simulation & Gaming",
issn = "1046-8781",
publisher = "SAGE Publications Inc.",
number = "4",

}

Evaluating the usability of authoring environments for serious games. / Slootmaker, Aad; Hummel, Hans; Koper, Rob.

In: Simulation & Gaming, Vol. 48, No. 4, 01.08.2017, p. 553-578.

Research output: Contribution to journalArticleAcademicpeer-review

TY - JOUR

T1 - Evaluating the usability of authoring environments for serious games

AU - Slootmaker, Aad

AU - Hummel, Hans

AU - Koper, Rob

N1 - DS_Citation:Slootmaker, A., Hummel, H. G. K., & Koper, E. J. R. (2017). Evaluating the usability of development platforms for serious games. Simulations and Gaming.

PY - 2017/8/1

Y1 - 2017/8/1

N2 - Background: The EMERGO method and online platform enable the development and delivery ofscenario-based serious games that foster students to acquire professional competence. One of themain goals of the platform is to provide a user-friendly authoring environment for creating virtualenvironments where students can perform authentic tasks. Aim: We present the findings of an in-depth qualitative case study of the platform´s authoringenvironment and compare our findings on usability with those found for comparable environmentsin literature. Method: We carried out semi-structured interviews, with two experienced game developers whohave authored a game for higher education, and a literature review of comparable environments. Findings: The analysis shows that the usability of the authoring environment is problematic,especially regarding understandability and learnability, which is in line with findings ofcomparable environments. Other findings are that authoring is well integrated with the EMERGOmethod and that functionality and reliability of the authoring environment are valued. Practical implications: The lessons learned are presented in the form of general guidelines toimprove the understandability and learnability of authoring environments for serious games.

AB - Background: The EMERGO method and online platform enable the development and delivery ofscenario-based serious games that foster students to acquire professional competence. One of themain goals of the platform is to provide a user-friendly authoring environment for creating virtualenvironments where students can perform authentic tasks. Aim: We present the findings of an in-depth qualitative case study of the platform´s authoringenvironment and compare our findings on usability with those found for comparable environmentsin literature. Method: We carried out semi-structured interviews, with two experienced game developers whohave authored a game for higher education, and a literature review of comparable environments. Findings: The analysis shows that the usability of the authoring environment is problematic,especially regarding understandability and learnability, which is in line with findings ofcomparable environments. Other findings are that authoring is well integrated with the EMERGOmethod and that functionality and reliability of the authoring environment are valued. Practical implications: The lessons learned are presented in the form of general guidelines toimprove the understandability and learnability of authoring environments for serious games.

KW - authoring environment

KW - development process

KW - functionality

KW - game design research,

KW - learnability

KW - operability

KW - reliability

KW - scenario-based serious games

KW - understandability

KW - usability

U2 - 10.1177/1046878117705249

DO - 10.1177/1046878117705249

M3 - Article

VL - 48

SP - 553

EP - 578

JO - Simulation & Gaming

JF - Simulation & Gaming

SN - 1046-8781

IS - 4

ER -